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PREFACE 



This book is based on a course presented at the Lewis Research Center. 
The course was given to engineers and scientists who were interested in in* 
creasing their knowledge of differential equations. Those resuUs which can 
actually be used to solve equations are therefore emphasized; and detailed 
proofs of theorems arc, for the most part, omitted. However, the conclusions 
of the theorems are stated in a precise manner, and enough references are 
^ven so that the interested reader can Bnd the steps of the proofs. 

In spite of the fact that difierential equations is a branch of mathematics 
which is to some extent a collection of loosely related ideas, we have attempted 
to impart as much unity to the subject as possible and to point out the connec- 
tion between the various topics. Although the material is not new, some parts 
of the presentation are unconventional. Certain modern ideas, such as the 
theory of matched asymptotic expansions, which have not worked their way 
into most conventional texts, are also included. In the chapter on numerical 
methods, we have attempted to include a discussion of the considerations 
which should be taken into account when applying the methods to various 
problems which arise frequently in practice. Techniques for solving first-order 
partial difTerential equations are discussed in the chapter on systems of ordi- 
nary differential equations since it is felt that these topics are easier to under- 
stand when they are presented simuhaneously. 
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CHAPTER 1 

Introduetion 



In this chapter we shall introduce some preliminary concepts and try to 
gain a certain amount of insight into the behavior of difTerential equations and 
their solutions. Such questions as what is meant by the solution of a differential 
equation and what is the appropriate number of solutions will be considered 
with some care. 

Leibniz, in 1676, was probably the first to introduce the term "differential 
equation.^* However, the study of difTerential equations had its beginnings 
somewhat before this time in investigations of physical phenomena. Ever since, 
developments in the field of differential equations have been closely related to 
the physical sciences. 

1.1 SOLUTION OF EQUATIONS IN GENERAL 

In this section we introduce some concepts which are needed for the 
subsequent presentation. First, in order to obtain a geometric interpretation 
of certain results, we shall have occasion to interpret a set of n variables, say 
Xi, . . ., Xn, as coordinate axes in an n-dimensional space. A particular set 
of values, say a:?, . . ., xS, of the n variables are then the coordinates of a 
point in this space. When n = 2 and n = 3, these spaces are the very familiar 
two- and three-dimensional Euclidean spaces. Hence, as will be seen, this 
procedure allows us to use our geometric intuition about two- and three- 
dimensional spaces to "picture"' results about functions and equations involving 
any number of variables. 

We shall not need to use many of the mathematical properties of the 
n-dimensional spaces; however, it will be important to have a careful defini- 
tion of certain special regions in these spaces. Thus, let :c?, . . ., be the 
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coordinates * of a fixed point in an n^dimensional space^ and condidcr tbr 
collection of all points whose coordinates satisfy the inequalities 

for some positive number 6. When n — 2, these points form the interior of a 
square with center at (x?, j^) and sides of length 26. When n=3, the points 
form the interior of a cube with center at {x^^ x^^ x^) and sides of length 28. 
The reason for using the word "interior" is that the boundary points which 
satisfy the equalities 

have been omitted frou the collection. 

Next we define a domain D to be any region of the n^dimensional space 
which satisfies the following two conditions: (1) there exists a positive number 
6 for each point x^^ . , x^ belonging to D such that every point Xu . . Xn 
lying in the range 

\xt-x^i\<8, . . .,\xn-xP„\<d 

is also a point of D; and (2) any two points in this region can be connected by a 
continuous line. Thus, in a two-dimensional space the first condition requires 
that we be able to draw around each point of D a square whose interior lies 
entirely within D. This is illustrated in figure 1-1. The only points where this 
is not possible are the points which lie on the boundary F of D. This is because 
every square about a point of T must include at least some points which do not 
belong to D. Thus, the first condition serves to exclude the boundary points 
from D. 

The second condition simply requires that the region not be composed of 
two or more disconnected subregions, as shown for two dimensions in figure 
1-2. 

A neighborhood of the point is simply a domain which contains 

this point. Evidently, the collection of all points which satisfy the inequalities 
in condition 1 form a neighborhood of the point . . ., x^. 



* Instead of saying that x7« • > •« ^ arc the coordinates of the point« we shall frequently say that the collection 
xf, . . .,xii is the point. 
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Figure I-^I. — Interior and boundary points for a domain D. 




Figure 1-2.— Disconnected regions which fail lo satisfy condition 2 for a domain. 



A single-valued function in the x, y-plane can be roughly thought of as 
one or more curves which associate a single value y with each value x. For 
example, the function :tV2 shown in figure l-^S associates the single number 
0^2 with each point x^^ On the other hand, a multivalued function associates 
more than one value of y with each value of x For example, the function 
tan-^ Xy which is shown in figure 1-4, associates infinitely many values of y 
with each value of x. 

In order to avoid ambiguity we shall always suppose that every function 
which is encountered is single valued unless explicitly stated otherwise. 

Consider the equation 

F{x,y)^0 (1-1) 
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Figure 1-4. — Function y-^tan-*x 
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where F had continuous first partial derivatives with respect to its arguments. 
We say that the function y^f {x) is a solution of this equation if 

F[xJ{x)y-^0 

for all values of at for which f(x) is defined. The solutions y^f(x) of equation 
(1-1) are said to be determined implicitly by this equation and arc called 
implicit functions. 

In fact, the implicit function theorem states that for every point {xq^ yo) 
such that 



FUo,ro) = 0 

and 

|jUo,yo)^0 

there is a unique^ continuous solution y^f{x) of equation (1- i) which is de- 
fined on some neighborhood of the point xo, which satldiies the condition 
yo=/(j:o) and which has a continuous first derivative in this nei^borhood. 

Now \{F(x^y) is a reasonable function, equation (1-1) will be the equation 
of a curve in the at, y-plane. For example, the implicit relation between x and y 

F(x.y)^x-y'^Q (1-3) 

is the equation of the cubical parabola shown in figure 1-5. It has an explicit 
solution given by^ 

y=/(^)^(sgnx)W>/3 (1^) 

for all values of AT. 



* The funclton ^^t\x U ilrfinrd by 



sicn X 



+1 forx>0 
I - 1 for X < 0 
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X 



Figure 1*5.— CuWcal parabola j:=y'» 



Differentiating this equation with respect tojc shows that 

dx ^ 3|:c|2/3 

Hence, condition (1-2) is satisfied at any point A on the curve in figure 1-2 
which does not coincide with the ori^n. And, as required by the theorem, 
equation (1-4) provides a unique solution with a continuous first derivative 
in some neighborhood of this point. However, condition (1-2) does not hold 
at the origin. But then the solution (1-4) has an infinite derivative (which is 
certainly discontinuous) at this point. 

More generally, consider the equation 

F(xuxz, . . M^niy)=0 (1-5) 

A solution to this equation is a function 

6 
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with the property that 

for all values oi Xu x^^ . . Xn for which / id defined. In order to obtain a 
geometric picture of equation (1-5) and its solution, it id convenient to think 
of the variables xi, JCa, . . Xn, y as the coordinates of a point in an (/iHh 1)- 
dimensional space. 

Now suppose that the function F has first partial derivatives with respect 
to its arguments in some domain D of this space. The implicit function theorem 
now shows that for every point (x?,j:S, . . .,jti\ y^) of £> such that 

FU?,x§ x{|,y>)=0 

there is a unique continuous solution 

y^fixuX^n . . M^it) 

of equation (1-5) which is defined in some neighborhood of the point jc?, 
xl, . . satisfies the condition /=/(x?,;»^, . . odi) , and has continuous 
first partial derivatives in this neighborhood. 



1.2 DEFINITION OF DIFFERENTIAL EQUATION 

A differential equation is an equation connecting the values of a function, 
called the dependent variably the derivatives of this function, and certain 
known quantities. If the dependent variable is a function of a single variable 
(independent) variables, the differential equation is called a partial differential 
differential equation. If the dependent variable is a function of two or more 
(independent) variables, the differential equation is called a partial differential 
equation. 

Thus, an ordinary differential equation is an equation of the form 

pi^-y'i ^)=<' 
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where the positive integer n, the order of the highest derivative which appears 
in equation (l--6)t is called the order of the equation and F is a function of 
the indicated n+2 quanliiies. 

If the function F in equation (1-6) is a polynomial of degree m in the 
highest order derivative d^yjdx^^ we say that it is a differential equation of 
degree m. Thus, the first-order differential equation of degree m has the form^ 

The differential equation (1-6) is said to be /mear if the dependent vari- 
able and all its derivatives appear only to the first degree. Thus, the general 
linear equation can be written in the form 

a«(:t)^+aiU)£^+. . . + an^i(x)^^+an(x)y+b{x)=Q (1-7) 

When the function b{x) in equation (1-7) is identically zero, the equation is 
said to be homogeneous. 



1.3 SOLUTIONS AND INTEGRALS OF DIFFERENTIAL EQUATIONS 

A {particular) solution^ of the difTerential equation^ (1-6) is any n- 
times differentiable function f(x) defined on some interval a<x<b (which 
may be infinite) such that equation (1-6) becomes an identity when y and its 
derivatives are replaced by f{x) and its derivatives. Hence, 

t yx^SKx), rfjc ' • • dx^ J " 

for all X in the interval a<x<b. Thus, the function y=sin a; is a solution 
of the differential equation + y=0. 



>Wc shall frcqucnily wrilc /' or /'(a:) for df(x)ldxj" oxf"(x) for d'fjdx' and/<»> or /<»)(*) in place 

ofrf"y7rfx*forn«l^, . . . 

*Thc term ••solution" was firsl used by Lagrange (1774). 

*Therc are also solutions known as weak solutions which satisfy the differential eq. (1-6) only in a certain average 
sense. We shall not pursue this topic further here. The interested reader is referred to ref. 1 for an elementary treat- 
ment and to ref. 2 for a more advanced discussion. 
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Now consider the equation 

F{x,y,cuC2, . . .,c„)=^0 (1-8) 



in v/hich x and y are variables, and Ci, 02, . . c„ are independent^ arbitrary 
constants.^ We shall suppose that equation (1-8) possesses solutions for at 
least certain values of the constants Ci, C2, . . M^n. 

Upon diiferentiating equation (1-8) with respect to Xy n times in succes- 
sion, we obtain 



dx dy 



d'^F dF 



(l^F dF 

If the n constants can be eliminated between these n equations and equation 
(1-8), we can, upon carrying out this elimination, obtain a differential equation ^ 

G[x,y,y\y' y<")]=0 (1-9) 

It is clear, from the manner in which equation (1-9) was obtained, that 
every solution of equation (1-8) satisfies^ equation (1-9). The function F 
is therefore sometimes referred to as a primitive of equation (1-9). In many 
instances the solutions of equation (1-8) for y as a function of x can be ex- 
pressed as formulas of the form 



^This means that eq, (1-8) is not expressible in tenns of fewer than n constants. For example, y^-'X^-hci — cz 
depends effectively only on the single constant c^cy — ca. 

^ We assume that all functions are differentiable as many times as is necessary for the argument and that dFldy 
is not identically zero. 

* In practice it usually will not be possible to carry out all the algebraic operations which are necessary to obtain 
an explicit formula for eq, (1-9). 

^ However* as we shaii see in the following example, the converse of this statement is not necessarily true. 
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y=/U,Ci,C2 Cn) (1^10) 

which are parameterized by the n constants ci, C2, . . c^. We therefore 
anticipate that, for many nth-order differential equations, there exist formulas 
of the form (1-10) each of which contains n independent constants Ci, . . Cn 
and provides a solution to its corresponding equation for every set of values 
of these n constants for which the formula makes sense. Such a formula, 
if it exists, is said to be a general solution of the equation. 

This terminology should not be interpreted to mean, however, that every 
differential equation possesses a single general solution from which every 
solution to the equation can be obtained by suitably choosing the values of 
the constants. This is only true when certain restrictions are imposed on the 
differential equation (1-6). 

For example, consider the equation ^ 

F(^,y,c) =c2"«[^-c("-i>]2 + y«-l = 0 for/i=l orn = 2 (1-11) 

whe:^s c is an arbitrary parameter which can take on any real value. By differ- 
entiating this equation with respect to x we find that 

Fx + y'Fy = 2c"-i [a; - c<"-i>] + ny«- V' = 0 ( 1-12) 

First, consider the case where n=l. Then upon eliminating c between 
equations (1-11) and (1-12) we obtain the first-order linear equation 

y'+^7^=o (1-13) 

Now, for each value of c, equation (1-11) possesses a single solution 

y^\-c{x—\Y for-oo<^<oo (1-14) 
This must, therefore, be a general solution to the differential equation (1~13). 



It is usually necessary to restrict the range of the c*s and o{x in order to avoid imaginary expressions and other 
degeneracies. 

"When n = l, the equation represents a family of parabolas with vertices at the point ;r=l, y=l; and when 
n = 2, it represents a family of unit circles with centers on the ;r-axis. 
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And it happens that every solution to equation (1-13) can be obtained from 
equation (1-14) by a suitable choice of the constant c. 

Next, consider the case where n = 2. Then upon eliminating c between 
equations (1-11) and (1-12) , we obtain the differential equation 

3^(y^-f 1)"-1==0 - (1-15) 

For each value of c, equation (1-11) now possesses the two solutions 

,= _V1^I^| for|.-c|.l (1.16) 

Hence, both of these formulas are general solutions to equation (1-15). Thus, 
there is no single formula involving only a single parameter from which every 
solution can be obtained.*^ This is not surprising since equation (1-15) can 
be written as 

and since only 3^ appears in this equation, it is clear that if y = f{x) is a solution, 
so is y =—/(:«:). 

Even though equations (1-16) are the only general solutions to equation 
(1-15), it is still not possible to obtain every solution to the differential equa- 
tion from these two formulas. Thus, equation (1-15) also possesses the two 
solutions 



y=+l 

y=-l 

which not only cannot be obtained from either of equations (1-16) but do not 
even satisfy the primitive equation (1-11). They are called singular solutions 
of equation (1-15) (see section 1.5) and are tangent to every solution obtained 
from the general solutions. 



*2 For any posilive real variable \^ will always denote the positive square root oix, 

*3 Notice that we can combine the two eqs. (1-16) into ft single formula y= (—1)" VI — (x — c)^ for /i = 0, 1, 
but this solution involves the two parameters n and c, 

11 
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We have shown how. an nth-order diflferrv4tial equation can be obtained 
by successively differentiating an equation of the type (1-8). In fact if, for a 
given differential equation, we can find an implicit relation of the type (1-8) 
such that every solution of the differential equation is also a solution of this 
equation, we can for practical purposes consider the differential equation 
solved. Thus, the process of finding a solution to a differential equation might 
be thought of as reversing the process of obtaining a differential equation 
from its primitive. The first step of this inverse process when applied to the 
nth-order differential equation (1-6) (if it can be carried out) leads to a differ- 
ential equation of order n — 1 which involves a single arbitrary constant c. 
And if this equation can be solved for c, it can be written in the form 

H{x,y,y\ . . .,3^«-i))=c (1^18) 

More generally, if for any given function H every solution of equation (1-6) 
satisfies an equation of the form (1-18) for some value of c, this function 
(and sometimes eq. (1-18) itself) is called a (first) integral of equation (1^6). 
Geometrically, this means that an integral H is constant along every solution 
curve y =/(:c ) of the differential equation. 

1.4 SOLUTIONS TO NORMAL EQUATIONS 

If we try to find a solution to equation (1-15), say 

which satisfies the initial condition /(1)=0, we find from the first equation 
(1-16) that 

and from the second equation (1-16) that 



Since integration is the inverse of differentiation, the preceding remarks show why the process of solving a 
differential equation is sometimes referred to as integrating the equation. 
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Therefore, equation (1-15) has two solutions which satisfy the condition 
y=0 at x=l. However, we usually expect the solution of any first-order 
differential equation arising from a physical problem to be uniquely determined 
by a single initial condition. It is, therefore, necessary to find what conditions 
must be imposed on a given differential equation if our expectations are to be 
justified. To this end suppose that equation (1-6) can be solved for its highest 
order derivative. It can then be written as an equation of the form 

y«) = G(rt,y,y', . . .,y<«-^)) (1-19) 

Any ordinary differential equation which has the form of equation (1-19) is 
called a normal differential equation or is said to be in normal form. 

We are interested in finding conditions which ensure that equations of 
this type possess unique solutions satisfying the initial conditions 

x^Xiuy^Yo.y^Yu . . = (1-20) 

where Fo, . . ., are constants. The fundamental theorem for mh-order 

differential equations states that this is always the case, at least locally, 
provided that certain restrictions are imposed on the function G. In order to 
state this theorem in a precise way, let us for the moment treat the variables 
X, y^y\ > . y(n-i) as independent. Then if there exists a positive number 8 
such that the functions 



^ dG /.on 



are defined and continuou-^^ for all values of the variables x, y, y\ . . ., 
1) which lie in the range 

\x-xo\ < 8, \y-yo\ < 8, |y' -yj < 8 < 8 

the fundamental theorem states that equation (1-19) possesses a solution. 
y=f{x) which satisfies the initial conditions (1-20) and is defined on some 



Notice that only the partial derivatives of G with respect to the variables . . .» /"^ need be continuous, 

but the partial derivative with respect to x need not even exist. 
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interval containing the point x — xo^ say 

a<x<b (1-22) 

In addition, this solution is unique. This means that iig{x) is any other solution 
to equation (1-19) which satisfies the initial conditions (1-20), then 

fix) - g{x) 

for all in the interval (1-22). 

Notice that we have only asserted that the interval (1-22) exists; we have 
not given any idea of its size.^*^ That is, there is no relation ^ven between a, 6, 
and 8. The interval might be exceedingly small. However, we shall give a 
measure of the size of this interval for an important special case. Thus, if the 
partial derivatives (1-21) are defined and continuous for aU values of y, y\ 
. . ., y^""^^ and for all values of x in some interval which contains the point 
x^xoy say 

a<x<l3 (1-23) 
and if there exists a single constant K such that 

dG 

J^^^ for 1 = 0, 1,2, . . .,71—1 

for all y, . . ., y<"-i) and all x in the interval (1-23), the solution y=/(x) 
which satisfies the initial conditions (1-20) exists and satisfies the differential 
equation for all x on the interval (i— 23). 

For example, it is easy to verify that the equation 



/ = G(y)sl+y2 

has the solution y=tan {x+c). Since tan becomes infinite at :r=±7r/2, it 



" Actually, the same conclusions can be reached even when somewhat weaker conditions are imposed on the func- 
tion G in eq. (1-19). Proofs of the fundamental theorem can be found in refs. 3 to 5. 

In fact, a measure of the size of this interval can be ^ven in terms of certain bounds on the function G, See, for 
example, ref, 4, theorem 8, p, 118, 
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is clear that the solutions to this differential equation are defined only on inter- 
vals whose lengths are ai most tt, even though G and dGldy are defined and 
continuous everywhere. This occurs because there is no constant K which is 
larger than dGldy= 2y for all values of y. 

Although we normally expect the solution of an nth-order differential 
equation to be uniquely determined by specifying n initial conditions (or the 
equivalent), we have seen by example that specifying these conditions is not 
necessarily sufficient to uniquely determine the solution to every nth-order 
equation. The preceding discussion indicates that the extraneous solutions 
must arise either because the differential equation (1-^) is not in normal 
form (i.e., solved in a unique way for the highest order derivative) or because, 
even if it is in the normal form (1"19), the function G is not sufficiently smooth 
at some points. 

A general solution to equation (1-19), if it exists, contains n **arbitrary" 
constants. And since, in principle, it is usually possible to solve n equations 
in n unknowns, this is consistent with the fundamental theorem which states 
that n initial conditions determine the solution to equation (1-19). 

For example, integrating the differential equation 



containing two arbitrary constants c\ and C2. The constants are uniquely 
determined by the initial conditions 



y' = ^2 



(1-24) 



twice yields the general solution 



X* 



(1-25) 



x=xo,'y=Yo,y' = Yi 



since the two equations 



12 



-\-CiXo-\-C2 



+ c 
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can be solved for Ci and ca to obtain 




C,= Yo-XoYy+^ 



More generally, suppose that by some formal process of integration we 
have found m general solutions < 

y=fiix,Ci,C2, . . .,c„) i=l,2, . . .,m (1-26) 

* 

of the differential equation (1-19) and that every solution of this differential 
equation can be obtained from these formulas by properly choosing the con- 
stants. Then for every set of values of the n constants jco, 5^o, Yi^ . . Y^i 
for which G satisfies the conditions imposed in the fundamental theorem, 
there must be one and only one value of i for which it is possible to solve the 
n equations 

Yi=^Hxo,CuC2, . . .,c„) 



for the n constants Ci, C2, . . .,Cn. 
For example , the function 

y=/U,c) ^Vl + ce^ (1-27) 

satisfies the differential equation 
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y = F(y)-i(y-i) 



(1-28) 



for all values of c for which the radical exists. And for this equation the partial 
derivatives (1-21) are always continuous except when y=0. Hence, the funda- 
mental theorem shows that there must be a solution which satisfies the initial 
condition - 



However, there is no possible choice of c in equation (1-27) for which /(O, 
c) = — 1, which shows that it is not possible to obtain every solution to equa- 
tion (1-28) from the formula (1-27). However, the function 



also satisfies equation (1-28) for all values of c for which the radical exists. 
Equations (1-27) and (1--29) taken together will now provide a unique solution 
for each initial condition which does not involve y= 0. But these formulas will 
provide two solutions satisfying each initial condition involving y=0, where 
the partial derivatives (1"^21) are not continuous. However, the fundamental 
theorem provides no information about solutions which pass through points 
where the partial derivatives (1-21) are not continuous. 

Specifying initial conditions is only one of many ways of determining the 
values of the arbitrary constants which appear in the general solutions of a 
differential equation. The most common alternative is to require that the 
solution and its derivatives satisfy certain conditions at both ends of some 
interval, say x ^ X2, within which this solution is being sought. These 
conditions are called boundary conditions'^ 

For example, we might require that the solution to equation (1-24) satisfy 
the boundary conditions 



The term "initial conditions" arose in conjunction with problems in mechanics which have time as the independ- 
ent variable and have conditions imposed at some initial time. The term "boundary conditions" arose in conjunction 
with problems involving physical distance as the independent variable with conditions imposed at the boundaries of a 
physical region. 



x = 0 



y=-l 



y=— Vl + ce^ 



(1-29) 
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y=yi at:t = ;ci 

Then substituting equation (1-25) into these conditions shows that 

yi = j^+cixi + c2 

^4 

y2 = j^+Ci;C2 + C2 

And since these equations have the unique solution 

^^_ yi""y2 J ^2~^i 
X1 — X2 12(xi— X2) 

^ _ X2yi — xiy2 I xiX2{xl'-x^) 

X2 — X1 \2{x2'^Xi) 

we conclude that the two boundary conditions uniquely determine the solution 
of equation (1-24). There are a number of theorems which give conditions 
which, if satisfied, will ensure that the solution of an nth-order equation wiU 
be uniquely determined by n boundary conditions. However, since these con- 
ditions are fairly complicated, we will hot state any of these theorems herein. 

1.5 SOLUTIONS TO EQUATIONS NOT IN NORMAl FORM-S8NGULAR SOLUTIONS 

We have shown that the nth-order normal differential equation possesses 
a solution which is uniquely determined by n initial conditions, provided that the 
conditions imposed in the fundamental theorem are satisfied. In order to use 
this result to obtain information about the solutions of a differential equation 
which is not in normal form, it is necessary to solve this equation, at least in 
principle, for its highest order derivative. 

First, consider the general nth-order equation of the first degree 

U{x,y, . . .,><"-i))y^">+n^,y, . . .,y^«'-iO = 0 (1-30) 
This equation can be written in the normal form 
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r Ui^,y,...,r J ^(^^^^ ^ ^ (1 31) 

for all values oi x, . . y^^"^^ for which i/ is not equal to zero. We shall 
suppose that U and V are defined and possess continuous first partial deriva- 
tives for all values of y, . . y^^-^\ Then the function G will possess con- 
tinuous first partial derivatives for all values of y, . . y^^"^^ at which 
U 9^0. Hence, the fundamental theorem shows that equation (1-30) will possess 
a unique solution satisfying any set of a initial conditions = :jco, y = yo, . . 
yin-i)^Yn-i for which U{xoy Yoj * . Fn-i) ^0. Each solution of equation 
(1-31) will satisfy equation (1-30); and if U is never equal to zero, every solu- 
tion of equation (1-30) will satisfy equation (1-31). Hence, in this case, equa- 
tions (1-30) and (1-31) are equivalent. However, suppose that the function U 
vanishes for certain values of its arguments. If equation (1-30) possesses a 
solution y= f{x) such that for certain values^^ oix 

£/(a:,/(;c),...,/(-i>(^))=:0 (1-32) 



then y—f{x) will not necessarily satisfy equation (1-31) for these values^" 
of X. It is called a singular solution of equation (1-30). 
For example, the first-order equation 

rr'-(y'-y)==o (1-33) 

can be written in the normal form 




(1-34) 



The normal equation (1-34) has the general solution 

y= 1 + ce^ 



**Thus y=f(x) satisfies both eq. (1-30) and the (n — l)8t«order differential equation [/(x^ y, , , y^^'^^)=0. 
Even if the numerator of G vanishes in such a way that it is possible to define G(jr,/(jc), . . .,/*"''*Hjr) ) at these 
values of X. 
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and this is also a general solution of equation (1-33). However, equation 
(1-33) also has the solution 

y=0 (1-35) 



but equation (1-34) does not. Since the coefficient of y' vanishes at y=0, 
equation (1-35) is a singular solution of equation (1-33). 

Now consider the general equation (1-6) and let us temporarily treat 
the quantities x, y, . . as independent variables. Suppose that F has 

continuous first partial derivatives with respect to its arguments. Then the 
implicit function theorem (given in section 1.1) shows that equation (1-^) 
has several (possibly infinitely many) solutions of the form 

^n)^C{x,y. . . .,y"-^)) (1-36) 

where the function G is continuous and has continuous first partial derivatives 
for all values of its arguments for which it is defined. One of these solutions 
will satisfy equation (1-6) for each set of values of y, . . y^"^ for which 
equation (1-6) holds and 

j~{x,y, . . .,y»))^0 (1-37) 

However, equation (1-36) is a normal differential equation; and therefore the 
fundamental theorem shows that it possesses a unique solution satisfying 
any set of initial conditions Jt = Jto, y = Ko, ■ . y^"-^^ = Yn-i for which G{xq, 
Ko, . . i^/i-i) is defined. All the solutions of the normal equations of the form 
(1-36) obtained from equation (1-6) will satisfy equation (1^). If dFjdy^^^ 
is never equal to zero for any values of y, . . y(») for which equation 
(1-6) holds, every solution of equation (1-6) will satisfy one of the equations 
(1-36). Hence, in this case, equation (1-6) is equivalent to the set of normal 
equations of the form (1-36). However, suppose that 

dF 

{x.y.y. ■ ■ ■,y">)=0 (1-38) 



ay 



n) 



for certain values of Jc, y, . . ., y^^\ li equation (1-6) possesses a solution 
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y—f(x) such that for certain values 2> of jc 

^(-tJU), . . .,/(")(;c)) = 0 (1-39) 

then for these values of jc the implicit function theorem no longer guarantees 
that there will be normal equations (satisfying the conditions imposed in the 
fundamc al theorem) which are satisfied by the solution y=^f{x) of equation 
(1-6). This solution is, therefore, called a singular solution of equation (1-6). 
For example, the equation 

F{y.y') =/2+l-y=0 (1-40) 

has the two solutions 

/ = Ci(y) =V7^ (1-^1) 

y = G2{y) ^-Vy-1 (1-42) 

where d and G2 have continuous derivatives for all values y for which equa- 
tion (1-40) holds and for v/hi^h 

1^=2/^0 (1-43) 

Now equation (1-^H) has the solution 

y=l + ^(x-c)^ (oTx^c (1-44) 
and equation (1-42) has the solution 

y=l + ^{x-cy foTx^c (1^5) 



" Thus >=/(.v) saiisfifs btith the difTereritial eq. ( 1-6) and thr difTcrential rq. ( 1 -38). 
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y 






2 


1 1 1 


1 1 1 



X 



Figure 1-6. -Solutions of equations (1-41) and (1-42). 



For each value of c, these two solutions are the two branches of the same parab- 
ola. They are shown in figure 1-6. The solutions of equation (1-41) are shown 
as solid curves. The solutions of equation (1-42) are shown dashed. Notice 
that one solution to equation (1-41) and one solution to equation (1-42) 
pass through each point (such as point A) lying above the line y=l, which is 
consistent with the fundamental theorem. 

Equation (1-43) shows that the points where y' = 0 are exceptional. 
But, for those values of y and y' which satisfy equation (1-40), this can occur 
only when y=l. However, when y=l, dGJdy and dG^ldy become infinite; 
and therefore the fundamental theorem does not apply along this line. Equa* 
tions (1-41) and (1-42) (and, therefore, also eq. (1-40)) possess the sohition 

y=\ 

which lies along this line and which cannot be obtained for any choice of c 
from either equation (1-44) or (1-45). Thus, y=l is a singular solution. 
Notice that there are three solutions of equation (1-40) passing through each 
point on the line y= 1. 

Now consider the first-order differential equation ~ 

F{x,y.y')=Q (1^6) 

The singular solutions of this equation, if they exist, must also satisfy the 
equation 
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(1-47) 



When y can be eliminated between equations (1-40) and (1-41), we obtain 
the equation 



Since the singular solutions simultaneously satisfy equations (1-46) and 
(1-47), they must also satisfy equation (1-48). Thus, every singular solution of 
equation (1-46) can be found by solving equation (1-48). However, the con- 
verse is by no means always true. Since the symbol p is often used to denote 
y', equation (1-48) is sometimes called the p-discriminant equation and the 
curve described by this equation is sometimes called the singular locus. 
When attempting to find aU solutions of a first-order equation, the solutions to 
the p-discriminant equation should be checked to see if they also satisfy the 
differential equation. 

For example, consider the first-order quadratic equation 



where B, and C are functions of x and y. Upon eliminating y' between this 
equation and the equation 



(1-48) 



( , y , y ' ) = /4y'2 + fiy' + C = 0 



we find that the p-discriminant equation is 



Thus, for the first-order equation 



Fix, y, y' ) = xy^ - 3yy' + 9x^=^0 



(1-49) 



the p-discriminant equation is 



y^ = 4jc^ 
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which has the two solutions y'=±2x^'^^. Direct substitution shows that both 
these solutions satisfy equation (1-49); and, therefore, they are both singular 
solutions. 

1.6 LINEAR EQUATIONS 

In this section we present a number of important special properties which 
are possessed by the solutions of linear equations. The general form of the 
nth-order linear equation is given in equation (1-7). If fx{x) and f2{x) are 
any two solutions to a linear homogeneous differential equation and Ci and 
C2 are any constants, the function 

y=-c/i(^)+c/2(^) (1-50) 

is also a solution. This linear superposition principle is extremely important 
in analysis. It can easily be extended to include linear combinations of any 
number of solutions. Notice that the homogeneous equation always possesses 
the trivial solution y = 0. 

The equation obtained from a particular linear equation of the form (1-7) 
by setting b(x) equal to zero is called the associated homogeneous equation 
of this equation. Any solution to the associated homogeneous equation is 
called a homogeneous solution of the equation. Ifi{x) is any solution of equation 
(i-7) and if fni^) is any homogeneous solution of this equation, the function 

f{x)+cfH{x) 

is also a solution. Of course, the superposition principle holds only for the 
homogeneous solutions of a linear equation. 

Notice that the linear equation (1-7) can always be written in the normal 
form (1-19) with 

ao ao ao ^ 

for all values of x where the coefficient ao(^) is not equal to zero. It follows 
that for these values ofx 

dG an-^j jx) r - A 1 o 1 /I co\ 

37^=-""^^ for7=0,l,2, . . .,n-l (1-52) 
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Now suppose that the coefficients ao, ai, . . an, b of equation (1-7) are 
all continuous in some finite interval 

a^x^fi (1-53) 

Then if ao{x) does not vanish at any point of this interval, it will always be 
possible to find a constant K such that^ 

- ^^n^^^K for7=l,2,3, . . .,n-l 

and for all :c in the interval (1-53). It can also be seen from equations (1-51) 
and (1-52) that the partial derivatives (1-21) are continuous for all values of 
y» y'» • • •» and all values of x in this interval. Hence, in this case, G 

not only satisfies the conditions imposed in the fundamental theorem, but it 
satisfies the more restrictive conditions given immediately following it. 

We therefore conclude that for linear equations the fundamental theorem 
can be stated in the following way: 

Let the coefficients ao(x), ai(x), . . ., an(x), b(x) of equation {1-7) be con- 
tinuous on some interval a < x < /3 which contains the point xo, and suppose 
that the function ao(x) does not vanish in this interval. Then for any real numbers 
Yo, . . ., Yn there is a unique solution y = f(x) of equation {1-7) satisfying the 
initial conditions 

rU) = Ko,y'(;co) = y„ . . .,y<"-')Uo) = F„-i 

And this solution satisfies the differential equation on the entire interval 
a < X < /3. 

If the linear equation (1-7) has coefficients which are continuous in some 
interval, the points in that interval where the coefficient ao(:J:) vanishes are 
called singular points of the equation. We shall have more to say about such 
points subsequently. 

A set of functions g\{x)^ g2{x)^ . . gn{x) is said to be linearly inde- 
pendent in an interval if it is impossible to find constants Ci, . . Cn which 
are not all zeros such that the expression 



This means that neither a nor/3 is equal to infinity. 
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Clgl{x)+C2g2{x) + 



+ C„gn{x) 



is equal to zero at all points (Le., identically) of the interval. A set of functions 
which is 710^ linearly independent is said to be linearly dependent. 

If the set of functions gi{x), . . gn{x) is linearly independent, no one 
of these functions can be expressed as a linear combination of the others. 
Hence, if a,- 9^ 0, it will not be possible to express the function 

f{x) = aigi{x) + a2g2{x)+ . . . +ar^n{x) (1-54) 

in the form 

f{x)=eigi{x)+e2g2{x)+ . . . +ei-igi^i{x)+ei^tgui{x)+ . . . +engn{x) 

in which the function gi{x) no longer appears. Thus the constants appearing 
in equation (1-54) are independent.^^ 

For example, the functions gi{x)=2x—5 and g2{x)=6x—15 are not 
linearly independent since 

cigx {x)+C2g2{x)=0 

when Ci = 3 and C2 = — 1 . However, the functions 

gi{x)^2x--5 and g2{x) = 2x + 5 

are linearly independent. 

Let gu g2, . . fiTn be a set of (n — l)-times continuously difFerentiable 
functions. The determinant 



gl 



g% 

g2 



gn 
g'n 



^'This means that eq. (1-54) is not expressible in terms of fewer than n constants. 
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is called the Wronskian of these functions. Now suppose that the functions 
6*1^ git ' ' gn are linearly dependent on some interval. Then there exist 
constants Ci, Co, . . » , Cn not all zero such that 

Cigi{x)+02g2{x)+ . . . +Cngn{x)=0 

at every point of the interval. Hence, we can differentiate this expression 
n — l times to obtain 

Clg[{x) + C2g'^{x) +. . .+ Cng'^ix) =0 



Cl^r'^{x)+C2^2^-'Kx) + - . • + Cr^^-'Kx) = 0 

This gives us a set of n linear equations for the n nonzero constants 
If these equations are to be solvable for the constants at all 
points of the interval, the Wronskian must vanish at all points of this interval. 
Hence, we can conclude that if the ^ef gi, gz, . . ., &i of {n — \)-times continu- 
ously differentiable functions is linearly dependent on the interval o: ^ ^ jS, 
.the Wronskian of these functions must vanish at all points of this interval. 

Another way of saying this is that if the Wronskian of a set gi^ . . gg^ 
of {n — lytimes continuously differentiable functions does not vanish at every 
point of the interval a ^ x ^ jS, these functions are linearly independent on this 
interval. 

Thus, the Wronskian of the functions (discussed in the previous example) 
gi{x) = 2x — 5 and g2(^) = 6:^:— 15 is 



W{gug2) = 



2x-'5 6x-15 

2 6 
= (2;c-'5)6-2(6;c-15) =0 



And this shows that these functions are linearly dependent. However, the 
Wronskian of the linearly independent functions gi{x) = 2x — 5 and g2{x) — 
2A:+5is 
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2x-5 2x + 5 



= -20 



2 



2 



which is certainly not equal to zero. 

Now consider the associated homogeneous equation of equation (1-7) 



and suppose that the coefficients ao, flti, . . . , fln are continuous in the interval 



and that ao(:x:) does not vanish on this interval. We shall now show that anyn 
solutions fi(x), . . fn(x) o/ equation (1-55) are linearly dependent on the 
interval {1-56) if, and only if their Wronskian W(fi, £2, . . fn) vanishes at 
every point of this interval. 

Another way of saying this is that the n solutions fi(x), . . fn(x) of 
equation {1-55) are linearly independent on the interval {1-56) if and only 
if the Wronskian W(fi, . . ., fn) is not equal to zero at some point of this 
interval. 

We have already shown that any set of (n — 1) -times continuously difFer- 
entiable functions is linearly dependent on an interval only if their Wronskian 
vanishes at every point of this interval. Hence, it is certainly true for a set of 
n solutions. '^"^ In order to show that, conversely, the vanishing of the Wronskian 
implies that the solutions are linearly dependent, suppose that ^(/i,^^, . . 
fn) vanishes at every point of the interval (1-56) and let rro be any point of this 
interval. Then the Wronskian certainly vanishes at this point, and therefore 
the system of n equations 



Recall that the definition of a solution requires that it be n — 1 times continuously differentiable. 



0 



(1-55) 



(1-56) 
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+ c,f„{xo)=0 



(1-57) 



has a solution Ci==Ci, C2=C2, . . ., c,i=c„ such that the constants Ci, Ca, . 
c„ are not all zeros. Hence, we can define a function f{x) by 



fix) = c/i {x)+c.if>{x)+ . . . + C./n (x) 



(1-58) 



Then it follows, from the linear superposition principle that f{x) is a solution to 
equation (1-55) in the interval (1-56). And differentiating eguation (1-58) 
n — 1 times shows that 

/ = c/i + c/2 + . . . + c/„ 

/'=c/; + +...,+ c/,; 



/(n-i)=e,/(«-i)_C2/(,"-i) + 



n-l) 



Hence, upon setting x = xq in this system and using equation (1-57), we find 
that the solution /satisfies the n initial conditions 



/U«)=/'Uo)- 



Since the trivial solution of the homogeneous equation (1-55) also satisfies 
these conditions and the fundamental theorem shows that there is only one 
such solution, we therefore conclude that f{x) is equal to zero at every point 
of the interval (1-56). Therefore, 
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at every point of the interval (1-56). But since the constants ci, C2, . . 
Cn are not all zero, this implies that the set /i,/2, . . .,/n is linearly dependent 
and therefore proves the assertion. 

We shall now show that the linear homogeneous equation (i-55) always 
has n linearly independent solutions on the interval {l-56)> To this end notice 
that for any point Xo of this interval the fundamental theorem shows that equa- 
tion (1-55) has n solutions fi{x) ^ f2{x) ^ . . .,/n(^) which satisfy the initial 
conditions 

Mxo) = i 

/.'Uo)=/i"Uo)= . . . =fi"-'Kxo)=o 

and for r= 2, 3, . . 



j\r)(xo)=f\r^'Kxo)^ . . .=fy^-'Hxo)=o 



It is easy to see from these conditions that the Wronskian of these n solutions 
has the value unity at the point xo> Thus, it is not zero at every point of the 
interval o: ^ jc ^ jS, and we can therefore conclude that these n solutions are 
linearly independent. 

For example, the second-order differential equation 

has the two solutions y= sin and y==cos x. 
The Wronskian of these solutions is 



fl^(sin x.cosx) = 



sm X cos X 
cos X sin X 



= — sin^iJC— cos^ x=-'l 7^ 0 
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Hence, the solutions are linearly independent. 

If {2^ * . *y fn <^^c any n linearly independent solutions of equation 
(7-55) on the interval {l-56)y and if h(x) is any other solution of equation 
{1-55) on this interval^ there exist constants Ci, C2, such that 

h{x)=^cxfx{x) + i^2{x)+ . . . + cnfn{x) (1-59) 

on the entire interval. 

This means that every solution to the equation on this interval can be 
obtained from the general solution 

f{x,CuC2, . . .,Cn)—Ctfi{x) + C2f2{x) + . . . + Cnfn{x) 

In order to prove this assertion, notice that since /i, . . .,/« are linearly 
independent, fl^(/i,/2, • . .,/n) cannot be zero at every point of the interval 
(1-56). Hence, there exists a point, say xo^ for which the Wronskian is not zero. 
The n equations 

h{xo) =Cxfi{xo) + c^2{xo)+ . . . +Cnfn{xo) \ 

h'{Xo)^Cxf,(xo) + C^2M+ . . . +CrfnM I 

> (1-60) 

* • . • I 

• • • • 1 

h(n-i)(xo) = crA^-'Kxo) + c^''-'Kxo)+ . . . +cf^^-^Hxo) j 

can therefore be solved for the n constants ci, 62, . . Cn. Hence, the linear 
superposition principle shows that the function g{x) defined by 

g{x) = cj'r{x) + c^2{x)+ . . . +Crfn(x) (IhSI) 

is a solution to equation (1-55) on the interval (1-56). And it follows from 
equation (1--60) that 

h{xo)=g{xo).h'{xo)=g'{xo). . . ..h(-''Kxo)=g^--'Kxo) 

But since the fundamental theorem shows that there is only one solution 
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satisfying a set of n initial conditions, we can conclude that g{x) = h(x) for 
all X on the interval (1-56). Equation (1-61) now shows that equation (1-59) 
holds, and this proves the assertion. 

It is easy to see from these results that equation (1^6) cannot possess 
n + l linearly independent solutions on the interval (1-56). 

Now consider the general linear equation (1-7) and suppose that the 
coefficients ao(jc), ai(jc), . . an{x)^ b{x) are continuous on the interval 

a^x^P (1-62) 

and that ao{x) does not vanish at any point of this interval. Letfoix) be any 
particular solution of equation (1-7); and let /i,/2, . . .^fn be any n linearly 
independent solutions of the associated homogeneous equation. Then if h(x) 
satisfies equation {1-7) on this interval we can find n constants Ci, . . Cn 
such that 

h{x) = 6rfi{x)+ . . . +c,fn{x)+fo{x) (1-63) 

on the entire interval. 

This means that every solution on the interval can be obtained from the 
general solution 



f{x,CuC2, . . Cn)=Cifi{x) + C^2{x)+ . . . + Cjfnix) +fo(x) (1-64) 

In order to prove this assertion, notice that h{x) —foix) is a solution to the as- 
sociated homogeneous equation of equation (1-7X Hence, we can find constants 
Ci,C29 • u .,Cn such that 

Hx)—fo(x) = Cxfi{x) + Cof2{x)+ . . . +Cifn{x) 

This shows that equation (1--64) holds and pro^/es the assertion. 
The general solution of the associated homogeneous equation 

Cxfi(x)+C^^2{x)+ . . . +Crfn{x) 

which appears in the general solution (1-64) of the nonhomogeneous equation 
(1-7) is called the complementary function. And any set of n linearly inde- 
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pendent homogeneous solutions is known as a set of fundamental solutions 
to the homogeneous equation. 

For example, the complementary function of the second-order equation 

^+y=x (1-65) 

ax- 
is Ci cos X + C2 sin x where Ci and C2 are arbitrary constants. A particular 
solution to this equation is y = Then 

y=Ci cos :x; + C2 sinx + x 

is a general solution of equation (1-65), and any other particular solution of 
this equation can be obtained by assigning particular numerical values to the 
constat tSsCi and € >, 
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First-Order Equations 



In this chapter a number of elementary techniques for obtaining explicit 
solutions for certain types of first-order equations are developed. These 
equations are chosen for consideration because they are simple enough to 
be solved explicitly and, at the same time, occur frequently enough in practice 
so that they are worth solving. As it happens, these equations are all of the 
first degree. 

2.1 SYAAMETRIC NOTATION FOR EQUATIONS OF FIRST DEGREE 

The first-order differential equation of the first degree is an equation of the 
form 

yW(^,y)+A/(^,y) = 0 (2-1) 

We shall suppose that M and N possess continuous first partial derivatives in 
some domain D of the y plane. If N{x^ y) were nonzero at every point of 
Z), we could write equation (2-1) in the normal form 

^■=/(-^'-ffe^ (2-2) 

and the fundamental theorem would guarantee that this equation have a 
unique solution passing through each point of/). Points of Z) where Ni^x^ y) =0 
are called singular points of the equation. 

In equation (2-1), y is considered as the dependent variable. The solutions 
of this equation are functions of the form 
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On the other hand, the equation 



y=f{x) 



(2-3) 



^M{x,y)+N{x,y) = 0 



(2-4) 



which is closely related to equation (2-1) possesses solutions which are func- 
tions of the form 



The singular points of this equation occur when M {x^ y) = 0. 

However, in any domain in which neither equation (2-1) nor (2-4) has a 
singular point, any solution (2-3) of equation (2-1) can be solved for x to obtain 
a solution of the form (2-5) of equation (2-4), and conversely. Thus, for many 
purposes, it is not necessary to distinguish between equations (2-1) and (2-2). 
When this is the case, we can intr». luce the symmetrical notation 



If M{x^ y) and N{x^ y) are both not zero, we understand this notation to 
denote either equation (2-1) or equation (2-4). When M{x^y)=Q but N{x,y) 
7^ 0, the existence of the solution (2-3) of equation (2-1) is guaranteed by the 
fundamental theorem, but that of equation (2-4) is not.-^ Hence, in the neigh- 
borhood of a point where M {x^ y) = 0 we understand the notation (2-6) to 
denote equation (2-1). Similarly, when N{x^y)=Q but M{x^y) t^O, we under- 
stand the notation (2-6) to denote equation (2-4). The fundameiUal theorem 
does not guarantee that either equation will possess solutions at points 
where M{x^y) and N{x^y) are both zero, and we therefore say that such 
points are singular points of equation (2-6) . 



-^At such points, dxjdy=^^ and dyldx = Oi hence, dxfdy is not continuous. 



(2-5) 



M{x,y)dx + Nix,y)dy=0 
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2.2 EXACT EQUATIONS 

The first-order differential equation of the first degree 

M{x,y)dx + N{x,y)dy-=0 ^ (2-7) 

with M and denned and continuous in some domain D, is said to be exact 
in D if the line integral 



[M{x, y)dx + N{x, y)dy] 



has the same value for all paths of integration which lie in D and which have the 
same end points. This is equivalent to requiring that the integral vanish around 
every closed path within D. 

It is shown in books on calculus that the differential equation (2-7) is 
exact if, and only if, there exists a continuously differentiable function <f){x, y) 
such that^^ 

M = ^ and N^^ (2-8) 
dx By 

Then the function 0, which is defined only to within an additive constant, 
is given by 

r(x.y) 

</>U,y)= i (yi^ a +A^c?y) + constant (2-9) 
•/(xo.yo) 

where (xo^ Jo) is any fixed point and the integral is carried out over any curve 
r within D which joins the fixed point {xo, yo) with the variable point (x, y). 

Suppose that equation (2—7) is exact. Then it follows from equation (2-8) 
that the total derivative of (f> with respect to x along any direction is 

Similarly, the total derivative with respect toy is 



Alternatively, we can say thai M dx-^ N dyh an exact differential of the function <^ or that d(f>^M dx-^-N dy, 
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#=M+M^=yV+fM (2-11) 
ay dy dx ay ay 

Since the differential equation (2-7) denotes either the equation 

M+y'N = Q 



or the equation 



ay 



equations (2-10) and (2—11) show that <f> is constant along every solution 
curve of equation (2-7). Hence, </> is an integral of equation (2-7). However, 
for a first-order equation, finding its integral is equivalent to finding its solu- 
tion in implicit form. Thus, an exact equation can effectively be solved simply 
by carrying out the integral (2-9) along any convenient path. 

It is easy to see by differentiating equations (2-8) and interchanging the 
order of differentiation that, if M and are continuously differentiable, a 
necessary condition for equation (2-7) to be exact is that 



dM^dN ^2-12) 
dy dx V ^ 



Now suppose that the domain D his no holes. That is, it is similar to the 
domain shown in figure 2-1 (a) but not the one shown in figure 2-1 (b). Such a 
domain is said to be simply connected. 

Let r be any closed curve within D and let jR be the region enclosed by 
r, as shown schematically in figure 2-2. Then Green's theorem 

R 

shows that condition (2-12) is also a sufficient condition for exactness. If D 
were not simply connected, condition (2-12) would not be sufficient to ensure 
that the line integral will always vanish along a closed path such as T in figure 
2-2. 
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Figure 2-2. — Path of integration within D, 

We shall always suppose that the conditions of differentiability and con- 
nectedness given in the preceding paragraphs are satisfied and therefore that 
equation (2-12) is the necessary and sufficient condition for equation (2-7) 
to be exact. 

For example, consider the equation 

2jc — y , , 2y+x , 
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ixQ. y) 



► {X. y) 



(xq. yo) 



Figure 2-3.— Path of integration for finding integral. 



Then 



and 



^ d / 2a:-y\ y^- 
dy ^ dy\x^ + yV {x^ + y^) 



2 



= i_ / 2y+^\ ^ y'^-x^-^xy 
dx ~dx\x^ + yy U2 + y2)2 

Hence, equation (2-12) holds and the dilTerential equation is exact. Therefore, 
carrying out the integral (2-9) along the path depicted in figure 2-3 shows that 



x 

\n{x^ + y^) -^tan-^-^- constant 

y 



is an integral of the equation. 

Unfortunately, the majority of first-degree equations encountered in 
practice are not exact. It is therefore natural to ask whether there exists a 
function K{x^ y) such that the equation 

\{Mdx + Ndy)^0 (2-13 ) 
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(obtained by multiplying both sides of eq. (2-7) by \) is exact. It can be shown 
(ref. 3, p. 27) that such a function always exists, provided only that equation 
(2-7) possesses exactly one general solution. It is called an integrating factor. 
Integrating factors are certainly not unique for, if \ is an integrating factor of 
a given first-order equation, so is c\ for any constant c. 

Now if \ is an integrating factor for equation (2-7), the condition (2-12) 
for exactness must hold for equation (2-13). Hence, 

d{\M) ^ d{\N) 
dy dx 

or 

Thus, X is the solution of a linear partial differential equation (see section 3.3) 
which is usually more difficult to solve than the original ordinary differential 
equation. However, since it can be shown that every solution of equation 
(2-14) is an integrating factor of equation (2-7), it is only necessary to find a 
single partictdar solution to equation (2—14). 

Although, in general, finding an integrating factor is quite difficult, it is 
sometimes possible to accomplish this simply by inspection. For example, 
upon multiplying the equation 

[J{x)+y]dx-xdy-=0 
by Ijx^ we obtain the equation 

hlfM+y]dx-ldy^O 

And sjnce dldy[{f+y)lx^]^llx^ and dldx{-\lx) = W, this equation is 
exact. Then carrying out the line integral (2-9) shows that the differential 
equation possesses the integral 

X J 
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2.3 EQUATIONS OF THE TYPE 



giy)y'=Ax) + hix)G(^j fix)dx-j g{y)dy'j 

Many of the differential equations which can be solved by classical 
methods are special cases of the differential equation 

-g{y)dy+^nx)+h(x)G{^jf{x)dx- j ^(y)dy)] dx = 0 (2-15) 

where g{y),f{x)^ h{x)^ and G can be any functions of their arguments. In order 
to obtain a solution to this equation put 

U^jf{x)dx-jg{y)dy 

Then dU= f(x)dx—g(y)dy and equation (2~15) can be written as 

dU+h{x)G{U)dx^O 



It is easy to see that IIG(U) is an integrating factor for this differential equation 
and therefore that the equation 

+h{x)dx^O 



G(U) 

is exact. Hence, it follows from equation (2-9) that 

0 = j '^^^dU+ j h{x)dx = constant (2-16) 

is an integral of equation (2-15). 

We now show that many of the first-order normal equations, which are 
solvable by the classical methods, can be obtained by specializing the functions 
/» and G in equation (2—15) and, therefore, that the solutions of these 

equations (actually the integrals) are all given by equation (2-16). 
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First put G(t/) = 1, and h{x)=0. Then equation (2-15) becomes the 
general separable equation 

-g{y)dy+f{x)dx = 0 
and equation (2-16) shows that its integral is simply 

<t>= j f{x)dx'-j g{y)dy 

Now put C(£/)^(a/i8)e^/«//(e-^)-l, g{y)^aly, f{x) = h{x)^l3lx. 
Then equation (2-15) becomes 

dy=x^l-y'H(^^dx (2-17) 

which is the isobaric (or one-dimensional) equation. In this case, the integral 
(2-16) becomes 



ln(J^/!/«) fj^U 

In = constant 

I e"l"H{e-") - 1 



or 



— In = constant 



If we put a=)8= 1 in equation (2-17), we obtain the homogeneous equation 

dy=H(^dx (2-18) 

And equation (2-16) shows that its solution is 

'ylx 



H{V) 
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In order to recognize whether a given differential equation has the form 
(2--17), it is necessary to be able to determine whether any given function 
7}{x^ y) can be expressed in the form 

^(^/a)-lff (g) (2-19) 

A necessary and sufficient condition that 7f{x, y) can be expressed in this form 
is that there exist a number p such that 

V (tx. tPy) = tP-'j) (x, y) (2-20) 

for all values of t. 

In order to show that a function which satisfies the condition (2-20) can 
always be expressed in the form (2-19), put 1=^11 x in equation (2-20) to get 




=x^-P7}{x,y) 



Now choose a number a and define the number ft and the function H(U) by 
P = pa and H{U) =17(1, t/^'"), respectively. Then 

which shows that 7]{x, y) can be expressed in the form (2-19). 
For example, replace y by yt^l^ and x by xt in the function 



, x^y(^-y^aln y+y'ln x) 
^^""'^^ ^Malny-ln:c) 

to show that 

Hence, this function satisfies condition (2-20), and it can be put in the form 
(2-19) by introducing the variable y^yx to obtain 
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In the important special case where a:= )8 (corresponding to the homogeneous 
eq. (2-18)), condition (2-20) reduces to 

^{tx.ty)^y){x,^y) (2-21) 

A function of two variables which satisfies condition (2—21) is said to be homo- 
geneous of degree zero, which, of course, accounts for the name given to 
equation (2-18). More generally, a function of the n variables ^ti, JC2, . . Xny 
say 17(^1, JC2, . . Xn)'» is said to be homogeneous of degree k in the variables 
- . Xn if it satisfies the condition ' 

T){tXx, tX2, . . txn) —t^r)ixuX2, . . Xn) (2-22) 

for all values of t. 

Another well-known special case of (2—15) is obtained by putting 

G{U) = e-^'^-Ot/, hix) = if^ix) exp [(A - 1) J f{x)dx^, and g{y) = 1/y 

to obtain Bernoulli s equation 

dy=- [f{x)y+il}ix)y^]dx (2-23) 
It follows from equation (2-16) that its solution is 



exp 



ik--l) ( f{x)dx] r r f 1 

(k— 1)3^-* J ^^^^ [(^^1) J /(^)^^J rfrsc = constant 



(2-24) 

When A: = 0, equation (2—23) reduces to the first-order linear equation 

dy-- U{^)y + H^)lidx (2-25) 
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And equation (2~24) shows that its solution is 



y = e ^ /(x)rf. j^-!Ax).u ^ (^^^^ ^. constant 



g SfixUx 



2.4 RICCATI EQUATION 

The Riccati equation 

^ = /W +gix)y+k{x)f (2-26) 

can be thought of as a generalization of the linear first-order equation (2-25). 
This equation is sometimes called the generalized Riccati equation since 
Riccati actually studied the special case 

ax 

where b and c are constants. 

If a particular solution yi of equation (2-26) is known, the general solu- 
tion y of this equation is 



where U is the general solution of the linear equation 

^+{g+2yrh)U + h = Q 
which was solved in section 2.3. This follows from the relation 

-/- «y - Ay = ^ -/- «y, - Ay; -p (^ + «t/ + A + 2y,hU^ 
= -^[f +(* + 2y,A)£/ + A] 



dy 
dx 



= 0 
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Even if a particular solution is not known, it is still possible to reduce 
the problem of solving equation (2~26) to the problem of solving a linear equa- 
tion; but in this case the equation is of second order. In order to accomplish 
b this put 

Then U'lU = -yh and 

= ^ yhU' - yhU - yh'U = (y'h^ - yh)U - yh'U 

= -{f+gy)hU'-yh'U 
= -fhU-y{gh + h'^U 

= -fhU+{g+j\U' 
Hence, U satisfies the second-order linear homogeneous differential equation 

The converse of this statement is also true. That is, every second-order linear 
homogeneous equation can be transformed into a Riccati equation. 

Since iiriear second-order equations will be discussed extensively in 
chapter 6, we shall not consider the Riccati equation further here. 



ERIC 



CHAPTER 3 

Systems of Equations 



In this chapter, a number of important properties of systems of differential 
equations are discussed. We shall also show how the solutions of these systems 
can be used to obtain solutions to certain types of first-order partial differential 
equations. 



3.1. FIRST-ORDER NORMAL SYSTEMS 

In certain applications it is necessary to deal with systems of simultaneous 
differential equations. The set of n first-order normal differential equations in 
the n dependent variables yi, 72, . . yn 



(^i{x, yu y2, . . yn) 



^ = G2{x, yu y%, . . yn) 
ax 



(3-1) 



^ = G„(a:, yu y2, . . yn) 



is called a normal system. It provides a standard form to which all normal 
differential equations and all systems of normal differential equations can be 
reduced. For example, by introducing the new dependent variables yi defined 
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by 



dW 

yi+i-'^i for i = 1, 2, ... n - 1 



the nth-order normal equation (1-19) can be transformed into a first-order 
normal system 

dyi 



dx 



= 73 



dyn~i 



-^=G{x, yi, 72, . . yn) 

However, it is by no means alv/ays possible to transform a first-order normal 
system into a single nth-order equation. 

In order to obtain a geometric interpretation of the system (3-1) and its 
solutions, it is again convenient to think of the variables x, yi, 72, . . yn as 
being the coordinates of an (n + l)-dimensional space. The definitions of a 
domain and of a neighborhood in this space were given in section 1.1. Based on 
these ideas, the fundamental theorem for the first-order normal system can be 
stated as follows: 

Suppose that the functions Gi for i^^l ^2^ . . .^n are defined and continuous 
in some domain D and that the partial derivatives 



dGi 
dyj 



fori 



n; 1 



n 



are continuous in D. Then for each point (xo, y?, yS, . • y^ 0/ D equation 
(t?— 7) has precisely one solution 
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yi=fiix) 
yi=fi{x) 



yn=Mx) 



(3-2) 



which is defined on some interval a<\</3 containing the point xo and satisfies 
the initial conditions 



/iUo)=y?, /2Uo)=y5» • • •,Mxo)=y^ 



(3-3) 



The solutions of the system (3-1) can be visualized as curves in the 
(n + l)-dimensional space. Then the fundamental theorem states that there is 
precisely one such curve passing through each point of the domain D in this 
space. 

If H{x, yi, 72, . . yn) is a nonconstant function such that every solution 
to the system (3-1) satisfies an equation of the form*'^ 



Hix^yi^y29 . . yn) = constant 



(3-4) 



(the constant may be different for different solutions), then jfif (x, yi, y2 . . yn) 
is called an integral (or first integral) of the system (3-1). Thus, an integral of 
the system (3-1) is a function H which is not identically constant but is constant 
along each solution curve of the system. Therefore, upon differentiating H 
along any solution curve of the system (3-1) we obtain 

dK = §E^^^+ I dH dyn 
dx dx dy\ dx ' ' ' dyn dx 

dH , dH ^ , , bH r' —f\ 

dx dy\ oyn 



Notice that this definition of an integral is consistent with the one given in chapter 1 for the nth-order normal 
equation when the latter equation te transformed, by the procedure just described, into a first-order normal system. 
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provided that H possesses continuous first partial derivatives. But each point 
of Z) Hes on a solution curve of the system (3-1). Hence,// satisfies the equation 



"I r T — 0^1 + -r — U2 i- . 

ox dyi dy2 



dyn 



(3-5) 



at every point of D. Conversely, if H is any solution to equation (3—5) in D, it 
is certainly constant along every solution carve of the system (3-1). Hence, H 
must be an integral of this system. We have now shown that a nonconstant 
function H with continuous partial derivatives is an integral of the system 
(3-1) in D if, and only if, it satisfies the first-order linear partial differential 
equation (3-5). 

Each integral H of the system (3-1) determines a family of n-dimensional 
hypersurfaces in the region /), and every solution curve lies on one of these 
hypersurfaces. Now suppose that we have found n integrals, say //i, //2, 
. . . , Hn, of the system (3-1) which are defined in the region D. If the Jacobian 
determinant 



g(//i, . . ., Hn) ^ 

d{yu . ■ yn) 



dHn 

dyi 



dyn 



dHn 
dyn 



(3-6) 



of these integrals is different from zero in D, it will be possible^^ to solve the n 
equations 

Hiix.yu. . .,yn) ==ci, . . .,//„(:t,yi, . . .,yn) = c„ (3-7) 

for yi , . . . , y„ as functions of x. And these functions will depend on the n 
arbitrary constants Ci, . . ., Cn. The n equations (3-7) therefore implicitly 
determine an n-parameter family of curves in the (n+ 1) -dimensional space. 



2® This is a consequence of the implicit function theorem for systems of equations. See, for example, ref. 6. 
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Hi(x, Vi, = C3 



Hi(x, yi. = C2 




Hi(x, yi, y2) • Ci 



X 



H2(x, yi. y2) - C4 



H2(x, yi, y2) • C5 



Figure 3-1. — Relation between integral curves and surfaces of ordinary differential equations. 



But these curves must lie along the various mutual intersections of n hyper- 
surfaces 

i/i = constant, 7/2 = - constant, . . j?/„ = constant 

This is shown schematically in figure 3-1 for the case where n = 2. However, 
since every solution curve of the system (3-1) must simultaneously lie on n 
hypersurfaces, each of which corresponds to one of the n integrals Hx^ . . 
7/n, the solution curves must also lie along these intersections. Therefore, 
every solution to the system (3-1) can be obtained as an implicit solution of the 
n equations (3-7). That is, the n integrals //i, . . ., //« which have a non- 
vanishing Jacobian in D are just sufficient to completely determine ail the solu- 
tions of the systems (3-1) in D. However, the requirement that the Jacobian 
(3-6) be different from zero in D implies that the integrals are functionally 
independent in D. We therefore anticipate that the system (3-1) will possess 
n functionally independent integrals. This turns out to be the case, at least 
when the region Z) is chosen to be sufficiently small (see ref. 7). 



^*Thc functions Hi^ . . Hn are functionally dependent in D if there exists a nonconstant function o) o(Hu • • •» 
Hn such that cd{Hu • • Hn) =0 for all x, yi, . . rn in D. See ref. 6. 
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For example, consider the normal system 

dy z ^ / V xyi 

which is defined in some region D which does not include the planes yi =±yi. 
Since the two functions ^lU, yi, y2)=yiy2 and //2 = yf +y| — satisfy the 
equations 

dx 

and 



ayi \yr-y|/ \y|-y?/ 



a:. + ay, ay^ lyf-y|J ly|-y?j " 



we know that Hi and //o are two integrals ol this system. Since 



d(HuH2) 
3(yi,y2) 



y2 yi 
2yi 2y., 



= 2(y|-yf) 



the Jacobian of these functions does not vanish in D. And this shows that Ht 
and H2 are functionally independent. The solution curves lie on the inter- 
sections of the surfaces //i= constant with the surfaces //a = constant. Thus, 
every solution curve lies on an intersection of a hyperbolic cylinder and a 
hyperboloid (or cone). 

Now let //i, //2, . . Hn+\ be any n+1 integrals of the system (3-1) in 
some domain D. Since each of these integrals must satisfy equation (3—5), it 
follows that 
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dx oyi 



+ 



dy,, 



G„ = 0 



a// 



M+l 



dH 



dH 



n+l 



9y« 



G„=0 



And it must be possible to solve these equations for 1, d, 62, . . Gn at 
every point of Z). However, this can happen only if the determinant of the 
coefficients 



d{x,yi Yn) 



dx 
dx 



dx 



dHi 

dyi 

dfh 
dyi 



dH 



H+l 



dyi 



clHi 

dyn 
dfh 
dyn 



dH, 



dyn 



is zero at every point of But this means that Hi are functionally 

dependent. Hence, every set of n+l integrals of the system (3-1) is function- 
ally dependent. We have, therefore, shown that the system (3-1) possesses 
precisely n functionally independent integrals {at least in a sufficiently small 
region D). 

If n functions hix, yi y»), . . Inix. yi, . . ., yn) not all identi- 
cally zero can be found such that 
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is equal to dFjdx iox some nonconstant function F{x^ yi, . . yn)» then F 
will be constant along every solution curve of the system (3-1). Hence, F 
will be an integral of the system (3-1). The functions /i, . /n can be 
thought of as integrating factors.^^ Although it is usually difficult to find inte- 
grating factors, they can sometimes be guessed at from the symmetry of the 
problem. 

For example, consider the system 

dyi 
dx 

d^ 
dx 

dy3 
dx 

Then choosing I\=^h=h—\ gives 
lx[|^-(.,-.,)] + lx[fe-te 



Hence, = 71+72+73 is an integral of the system (3-8). Now choose /i = 
2yi, /2=2y2, and/3=2y3. Then 

Hence, //2==yt+yf+y3 is also an integral of the system (3-8). It is easy to 
verify that H\ and 'H2 are functionally independent. 



^ See section 2.2. 
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Instead of interpreting the solution (3-2) of the normal system (3-1) 
as the explicit equation of a curve in an (;i+ l)-dimensional space with 
coordinates yu . • yn» we can interpret it as the parametric equation 
(with parametric variable :c) of a curve in an n-dimensiohal space with coordi- 
nates yi, . . yn. The parametric variable :t may be the arc length or a similar 
parameter for the solution curves (such as the time in a physical problem). 
The fundamental theorem can still be used to show that there is a solution curve 
passing through every point of any region of this n-dimensional space, provided 
the functions Gi satisfy the appropriate smoothness requirements. However, 
except in a certain important special case (which is the topic of \he next sec- 
tion), it will usually not be true that only a single curve passes through each 
point of this region. 

The simplicity of the first-order normal systems becomes apparent when 
^equation (3-1) is written in vector notation. To this end we notice that the 
coordinates of a point yi, . . ., yn in the n-dimensional space can be interpreted 
as the components of an n-dimensional vector y and we write 

y=(yuy2. . . .,yn) 

A vector is said to be a function of a single real variable x if its components 
are functions of x. Thus, if (as in the case of the solution curve (3-2) of the 
system (3-1)), 

yi=/iU)» . • ^,yn=^fn{x) 

we write 

y^tix) ^ (fiix), . . .,fn(x)) 



Addition of two vectors and multiplication of a vector by a scalar are defined component*wise. Thus, if 
(yit . • and x=(xi, . . are vectors and a is a number, y + x= ((yt + . . (yii + ;rii)),ay== (ayi, . » ., 

ayn). The length or magnitude of the vector y is denoted by |y| and is defined as the distance from the origin to the 
point yu . . Xn. Thus, |y| — • . • Notice that the magnitude of a vector is zero if, and only if, its 

components are all zeros. The dot product or inner product of two vectors y and x is denoted by y • x and is defined 
by yx=ytXi+ . . . -^ynXn. The dot product satisfies the Schwarz inequality |y ' x| ^ |y| |x|, vhere the vertical 
lines on the left are the absolute value of a pure number and those on the right denote the magnitude of vectors. Thus, 
if (y| 7* 0 and |x| 7* 0 then |y ' x|/|y| |x| ^ 1 and this quantity can be interpreted as the cosine of the angle between 
the vectors y and x. If y • x = 0, we say that y and x are orthogonal; and if |y • x|/|y| |x| = 1, we say that the vectors 
are in the same direction. The vector (1, 0, 0, . . ., 0) has unit magnitude and is in the direction of the yrcoordinate 
axis. The vector (0, 1, 0, 0, , . ., 0) has unit magnitude and is in the direction of the yj-coordinate axis, etc. We denote 
these vectors by ki, ki.etc. For more information, see ref. 8. 
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Differentiation of vectors is defined component-wise, and we write 

^^(dli dyn\^df{x) ^( dfiix) dfn(x) \ 

dx \dx' ' ' dx ) dx \ dx ' ' ' dx / 

If /(yi^ • • -9 yn) is a function of the n variables yi, . . Jn and y= 
(yi^ • • -9 Yn) denotes the vector corresponding to these variables, we write 



f{yu • • y«)=/(y) 

and say that/is a function of the vector variable y. More generally, we say that 
a vector is a function of a vector variable if its components are. Thus, if yi = 
/i(x), . . ., y„=/„(x), then 



y=f(x)=(/i(x), . . .,/„(x)) 

is a vector function of the vector variable x. 

Notice that there is no such thing as the derivative of a function of a vector 
variable with respect to that variable, but only partial derivatives with respect 
to the components of the vector variable. Thus, if ki, . . ., kn denote the unit 
vectors in the directions of the coordinate axes, we define the vector gradient 
operator V by 

V/(x)=kx-^+ • • ■ + ^"-9^ 



Just as in the three-dimensional case, the effect of operating with the gradient 
operator on a scalar produces a vector. 

A vector function is said to be continuous if its components are continu- 
ous. Thus, in the system (3-1), each d is a function of a real variable x and a 
vector variable y and we write 

Gi{x,yu ■ . ',yn)'=Gi{x, y) 



If we let G be the vector whose components are Gf, then G is a vector function 
of the real variable x and the vector variable y and 
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G{x, y) = {Gi{x, y), . . .,G„ix,y)) 

Hence, upon using the component-wise definition of differentiation of vec- 
tors, the first-order normal system (3-1) can be written in the concise form 

When the first-order system (3-1) is written in this form, the analogy between 
this system and a single first-order equation becomes particularly apparent. 

3.2 AUTONOMOUS SYSTEMS ^ 

When the functions G, in the system (3-1) do not involve the variable x 
explicitly, the system is said to be autonomous and it can be v;ritten in the 
form 

dyi 



-^ = G2(yi,y2, . . .,yn), 



(3-9) 



-^ = G,i(yi,y2, . . .,yn 

If the independent variable x is thought of as representing time, autonomous 
systems can be interpreted as time-independent, or stationary, systems. 
The first-order normal system of « — 1 equation 

■^-Cri(yi,y2, . . .,yn-ux) 

■^=G2(yi,y2, . . .,yn-ux) 

(3-10) 



dyxi-\ ^ . , 
~';^=G„-i(yi,y2, . . .,yn-ux)\ 
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can always be transformed into an autonomous system in n variables which has 
the property that at least one of the functions on the right side never vanishes. 
In order to do this, it is only necessary to introduce a new dependent variable 
yn by 

yn=x 

and then rewrite the system (3-10) in the form 



dx 

Conversely, if one of the GiS of the autonomous system (3-9) in n variables 
does not vanish in some domain Z)o, it can be transformed into a nonautonomous 
system in n-1 variables plus an additional equation which can be solved to 
determine the variable x once the remaining variables have been found. We 
may assume without loss of generality that the notation has been so chosen 
that Gn does not vanish in Z)o. Now in order to accomplish this transformation 
put 



and 



x^yn (3-11) 



Gi^jr for 1^1^ {n-D (3^12) 
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Then the system (3-9) becomes 






(3-13) 




■ ■ yn-^u x) 



and the equation which determines x once the system (3-13) is solved is 



It can now be shown that every solution to the system (3-13) in Do is a 
solution of the system (3-9), and conversely. Thus, we may say that the systems 
(3-9) and (3-13) are equivalent in Do. 

The solutions of the system (3-9) in n variables can be found by solving 
the n — 1 simultaneouis equations (3-13) to determine yi , . . . , yn-i as functions 
of yn. And then a single equation obtained by substituting these solutions into 
equation (3-14) can be solved to determine the parametric variable :t as a 
function of yn. In order to emphasize the connection between the autonomous 
system of n equations (3-9) and the system of n — 1 equations (3-13), the 
former system is sometimes denoted symbolically by 



dx 



1 



(3-14) 



dx 



Gn{y\ 



■ ■ yn-u x) 



dyi ^ dy2 
Gi G2 



dyn 



Gn 



dx 



or, when finding the variable x is not important, by 



dyi _ dy2 
Gi G2 



dyn 

Gn 
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Thus, for example, consider the autonomous system of three equations 

^=G2(yi,y2,y3) =-nyiy, ^ (3-15) 
^=G3(yi, y3, ya) = yiy2y3 



Upon puttingic=y3 we get 



-^-^i\yuy2,x) = myiAc 



</y2 /s / -X _ ny2 



and X is determined by the equation 



^ The system (3-16) has the solution 



y\ = cxe =cie 



Finally, equation (3-17) shows that x is related to x by 

x = Cz-\ — ^ I jc'^-^ exp ( — J dx 
C1C2J \ 2 / 
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The interpretation of the solution of a normal system of n equations as a 
curve in an n-dimensional space is particularly useful when the system is autono- 
mous. This is the case because for autonomous systems, unlike nonautonomous 
systems in general, there is usually only a single curve passing through each 
point in this space. We can show that this is the case by applying the funda- 
mental theorem given in section 3.1 to the transformed system (3—13). This 
theorem applies to the ji, . . jn-i, x space in which the systep (3-13) is 
defined. But in view of equation (3-11), we see that this is the same as the. 
n-dimensional yi, . . y„ space in which the untransformed autonomous 
system (3-9) is defined. Thus, suppose that the functions Gi have continuous 
first partial derivatives with respect to all their arguments at every point 
in some domain D of the n-dimensional yi, . . yn space and that there is 
no point of D where all the Ct's simultaneously vanish. Then, because of the 
continuity of the Gi's, we can assert that for any point 3^, . . ., y^ of D there 
is a neighborhood Do in which at least one of the Gi's is never equal to zero. 
Within this neighborhood we can transform the normal system (3-9) into the 
system (3-13) and apply. the fundamental theorem in the region Z)o. Since the 
Gj's have continuous partial derivatives, we can conclude that the system (3-9) 
has precisely one solution curve in the /i-dimensional yj, . . yn space pass- 
ing through the point yf , . . . , y^. Now suppose the notation is chosen so that 
Gn does not vanish in /)q. Then Gn does not change sign in Do^ and equation 
(3—14) shows that x is a monotonic function of x along any solution curve 
in Z)o- Hence, we can take x as the parametric variable for the solution curve 
instead of x. Since this is true for every point of Z), we arrive at the follow- 
ing conclusion: If the function G which appears in the first-order autonomous 
system 

^=G(y) (3-18) 



possesses- continuous partial derivatives at every point of some domain D, and 
if |C(y)| does not vanish at any point ofD^ the system (3-18) has exactly 
one solution curve 



^^Notice that in this case the existence of the partial derivatives guarantees the continuity of the functions Gh 
^ We are using the vector notation introduced in section 3.1. 
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y = f(x, yo) (3-19) 

passing through each point yo of D. 

Thus, we can think of the "solution vector" (3-19) as tracing out a con- 
tinuous curve in the n-dimensional yu . . .» yn space, which passes through 
the point yo when the parametric variable takes on some value, say Xo. Such 
"solution curves" are called integral curves of the system (3-18). These ideas 
are illustrated in figure 3-2 for the case where n = 3. 

Notice that 111 order to ensure that the system (3-18) has only one integral 
curve passing through each point of i), it is necessary to require that |G(y)|, 
the magnitude of G(y) , does not vanish at any point of D. Points where |G(y) | = 
0 are called critical points of the autonomous system (3-18). 

If yo is a critical point of the system (3-18), this system must possess the 
constant solution 

which is called an equilibrium solution. 

For example, it may be verified by inspection that the solutions to the 
autonomous system 




Figure 3-2. — Relation between solution vector and integral curve of differential equation. 
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dx 



with n> niy are 



■ — n^oUX 



The point (0, 0) is a critical point. The integral curves of this system are the 
loci of points 

where k'^c^lc^. These curves are shown for the case where m and n are 
positive integers in figure 3-3. It can be seen from this figure that there is 




Figure 3-3. — Integral curves for sample problem. 
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exactly one integral curve passing through each point except the critical point 
(0,0). 

A vector function which is defined at each point of an n-dimensional 
space is said to constitute a "vector field." Since a unique vector-valued 
function G(y) corresponds to each autonomous system (3-18) and conversely, 
we can say that each first-order autonomous system is characterized by 
its vector field. 

Consider a portion of an integral curve of the system (3-18) which passes 
through a point y which is not a critical point and which lies in a domain D 
where G(y) is continuously differentiable. Let S denote the arc length meas- 
ured in some definite direction along this curve. Then 



{dSY={dy,y+{dy2Y+ . . . +{dynY 



or 



But equation (3-18) shows that 

|=±Vg:g=±|g| 



Hence, taking S as the independent variable in equation (3-18) shows that 



dy_dydx_ G 
dS~dxdS''-W\ 



However, the vector dy/dS is the unit tangent vector to the integral curve 
passing through y; and since there is an integral curve passing through each 
point of Z), we conclude that the vector field G(y) is tangent to the integral 
curves of the system (3-18) , except possibly at the critical points. 

When n=3, we can imagine that the variable x represents time and the 
autonomous system (3-18) represents the steady flow of a fluid in space. At 
each point y in a certain region of this space the vector G(y) describes the 
velocity of the fluid at that point in both magnitude and direction. The flow 
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is steady because its velocity depends only on position and does not vary with 
time. The integral curve passing through the point yo may then be interpreted 
as the streamline followed by all the fluid particles which have passed through 
the point yo. The velocity field is tangent to the streamlines at every point ex- 
cept at the critical points which correspond to "stagnation points" where the 
fluid velocity vanishes. At these points, it is possible for two or more stream- 
lines to meet or for a given streamline to abruptly change direction. 

By again applying the results obtained in section 3.1 to the autonomous 
system (3-9) by means of the transformed system (3-13), we arrive at the 
following conclusions: Suppose that Z? is a region of yi, . . ., space which 
contains no critical points of the system (3-9) and'that G has continuous partial 
derivatives at every point of D. Then a function H{y) of the vector variable 
y in D which does not depend explicitly on x is a solution of the first-order 
linear partial differential equation 

Giiy)^+. . . + Gniy)^^0 (3-20) 
dyi dyn 

if and only if it is an integral of the autonomous system (3-9). If, in addition, 
the region D is sufficiently small, the system (3-9) possesses precisely n — l 
functionally independent integrals which are independent of x. This shows that 
equation (3-20) possesses re — 1 functionally independent solutions. 

The level surfaces of these integrals are hypersurfaces in the n-dimensional 
ji, . . ., yn space. The intersection of any re — 1 of these hypersurfaces (no 
.two of which correspond to the same functionally independent integral) is 
a\n integral curve of the system (3-9) in this space. 

The partial diff^erential equation can be written more compactly by using 
the vector notation introduced in section 3.1 to obtain 

G-V// = 0 

In this form the equation has an immediate geometrical interpretation. As in 
three-dimensional space, the vector V// is perpendicular to the level surfaces 
of the function //. Hence, the diff^erential equation (3-20) merely states that the 
vector field G is everywhere tangent to the level surfaces of its solutions. This 
is consistent with the facts that the integral curves of the system (3-9) lie on 
these level surfaces and that the vector field G is tangent to these integral 
curves. 
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3.3 SOLUTIONS OF THE FIRST-ORDER LINEAR PARTIAL DIFFERENTIAL EQUATION 

Since equation (3-20) cannot have n functionally independent solutions, 
there must exist for any n solutions //i, . . //n of equation (3-20) a non- 
constant function o) such that 

0)(//l,7/2, ...,//n)-0 

for all yi, . . jn in some region D. Now it can be shown (ref. 6) that this 
equation can always be solved for Hn to obtain 

provided that Wi, . . ff„-i are functionally independent. But since //i, . . 
Hn were any solutions of equation (3-20), this shows that every solution of 
equation (3-20) can be expressed as a function of any n — l functionally inde- 
pendent solutions. Conversely, it is easy to verify by direct substitution that if 
//i, . . Hn-i are any solutions of equation (3-20) and F is any continu- 
ously differentiable function of //i, . . ., //n-i, then F(//i, //2, . . .,//n-i)is 
also a solution of equation (3-20). Thus, we have shown that H is a so lution of 
the linear partial differential equation {3-20) if and only if there is a function 
F such that 

H{y)=F{H^{y), . . .,//„_i(y)) 



where //i(y), . • ., //n-i(y) are any n — 1 functionally independent integrals 
of the autonomous system (3-9) which do not depsnd on x. 

Thus, the most general solution of the partial differential equation (3-20) 
can be found if the system (3-9) of ordinary differential equations can be solved. 
The differential equations (3-9) are therefore called the characteristic equations 
of the partial differential, equation (3-20) and their integral curves are called 
characteristic curves of the partial differential equation. 

For example, the characteristic equations of the partial differential 
equation 



in-n) 2^+(y3-yx) g+(yx-yO ^=0 (3-2i) 
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are the equations of the system (3-8). But we have shown that this system has 
the two functionally independent integrals 

Hi = yi + y2 + y3 

Thus, for every difFerentiable function F, the function 

must be a solution of equation (3-21). This can easily be verified by substitut- 
ing the relations 

dH dF , d dF r • 1 n o 

into equation (3-21). 

The level surfaces of the integral Hi are planes, and the level surfaces 
of the integral H2 are the surfaces of spheres. The intersections of the surfaces 
Hi== constant with the surfaces [12"= constant are therefore circles. Hence, 
the characteristic curves of equation (3-21) are circles. 

3.4 QUASI^UNEAR PARTIAL DIFFERENTIAL EQUATIONS OF THE FIRST ORDER 

There is also a close connection between the quasi-linear partial differential 
equation 

dyi oyn^i 

= Gn{yu . . ^.yn^ij) (3-22) 

and the linear partial differential equation (3-20) and, therefore, also between 
this equation and the autonomous system (3-9). In order to show this, let 

H^h{yu . . .,yn) 
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be any solution of equation (3-20) such that dH/dyn is not identically zero.^'^ 
Then the implicit function theorem shows that there is a neighborhood D of 
any point yo for which 



such that the equation 
has a solution 



I^^O (3-23) 
oyn 



h{yi y«) = ci (3«^24) 



y«=/(yi, . . ..Yn-uci) (3-25) 



in D. This means that when equation (3-25) is substituted into equation (3-24), 
the resulting expression is identically constant for all values of yi, . . yn^u 
Hence, upon differentiating this expression successively with respect to 
yi, . . y„_i, we obtain 

dyi dyn dyi 



dyn-\ dyn dyn-i 

But when these relations are substituted into equation (3-20), we find that 

oyn \ dyx dyn-^ij 



And, in view of equation (3-23), this shows that equation (3-25) is a solution 
of equation (3-22). 



This means lhaJ // is not independent of 
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Now there are n — 1 functionally independent integrals //i, . . Hn^i 
of the system (3-9), which are therefore functionally independent solutions 
of equation (3-20). If there is some point y at which these integrals all satisfy 
condition (3-23) , we can find at least n — 1 functions 



y«=/i(yi, 



yn-\f c,) 



(3-26) 



which, respectively, satisfy the equations 



Hn^\ — hn-i{yu ' ' •?y«)=Cn-i ,^ 



(3-27) 



in some neighborhood D of the point y. Therefore, each of the functions (3—26) 
is a solution to equation (3-22) in D. Since equations (3-26) determine explic- 
itly the same surfaces as equations (3-27) determine implicitly and since 
these surfaces determine the integral curves of the system (3-9), the equations 
of this system are also called the characteristic equations of equation (3-22). 
For example, the partial differential equation 



dy\ oyi 



(3-28) 



has the same characteristic equations as the linear equation in the preceding 
example, namely equations (3-8). These equations, as we have seen, have the 
two functionally independent integrals 
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Hi = yi + y2 + yi 

And equation (3-28) therefore has the solutions 

/i = Ci— (yi + ya) 

/2=±Vci-(y? + 3|) 
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In this chapter several methods for obtaining solutions to second-order 
differential equations are presented. Even though each of these methods applies 
to a relatively narrow class of equations, they are still of sufficient generality 
to be useful in practice. However, unlike the methods presented in chapter 2 
for solving first-order equations, most of the techniques presented in this chap- 
ter will not by themselves yield solutions to equations. They are, in fact, 
methods for transforming certain types of equations into simpler equations 
whose solutions can hopefully be found by known methods. We have already 
found a number of methods for solving first-order equations. The only other 
general class of equations for which it is possible to find numerous solutions 
is the class of linear equations introduced in chapter 1. Therefore, in section 
4.1 we present some techniques for reducing second-order equations to equa- 
tions of the first order. And in section 4.2 we present techniques which trans- 
form certain types of nonlinear equations into linear equations. Finally, in 
section 4.3 we present a number of unrelated methods. Although many of the 
methods presented in this chapter are applicable, with some obvic modifi- 
cation, to equations of higher order, we shall, for simplicity, limit the dis- 
cussion to second-order equations. 

As indicated in chapter 1, the most general second-order differential 
equation is an equation of the form 

whereas, the most general normal second-order equation is of the form 

73 



ERIC 



DIFFERENTIAL EQUATIONS 




(4-2) 



A general solution of equation (4-1) or of equation (4-2), if it exists, will 
involve two arbitrary constants. As in the case of first-order equations, there 
may be any number of general solutions to these equations. In addition, equa- 
tion (4-1) may possess singular solutions. These solutions are discussed in 
section 1.5. The methods presented in that section should be used to find any 
singular solutions which may be present since such solutions can be important 
in physical problems. 

Finally, the second-order linear equation is an equation of the form 

Po{x) ^+Pi(^) ^+P2{x)y==P3{x) (4-3) 

We shall assume the coefficients are continuous. Upon dividing through by 
the leading coefficient po(^)» we obtain the (essentially) normal form 

^2+PM%^QMy=rix) (4-4) 

This diff'erential equation is equivalent to equation (4-3) in any interval in 
which po{x) does not vanish. 

4.1 EQUATIONS WHICH ARE REDUCIBLE TO FIRST-ORDER EQUATIONS 

In this section a number of techniques, which can be used to reduce 
certain types of equations to equations of the first order, are described. 

4.1.1 Dependent Variable Missing 

When a second-order diff'erential equation does not explicitly contain the 
dependent variable y, it must be of the form 

But this equation can be written as a first-order diff'erential equation 
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for the quantity p defined by 




(4-6) 



It may or may not be possible to solve this first-order equation in any ^ven 
case. However, suppose that it can be solved and that its integral is 

/U» p) = constant = Ci (4-7) 

At this stage, there are two possible ways of proceeding, depending on whether 
it is easier to find an explicit formula for p as a function of x which solves^*^ 
equation (4-7) or whether it is easier to find an explicit formula for x as a 
function of p. 

First, suppose that the former case occurs. Thus, we can find an explicit 
formula 

p=g(x, Ci) 

for a solution to equation (4-7). Then, in view of equation (4^6), this equation 
can be immediately integrated to obtain a general solution 

y= J Ci)dx+C2 

of equation (4-5). 

Next suppose that it is easier to find an explicit formula 

x=h{p,Ci) ' (4-8) 
for a solution to equation (4-7). Substituting equation (4-8) into the relation 

dp dx 



See section 1.1. 
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shows that 




Hence, 




And, upon integrating this by parts, we obtain the equation 



y=ph{p, Ci)— h{p,Ci)dp + C2 



(4-9) 



which together with equation (4-8) determines the sohition y of equation (4-5) 
parametrically as a function of x (with p being the parametric variable). This 
parametric function involves two arbitrary constants. 

For example, the equation of the curve followed in the pursuit of a prey 
which moves along the y-axis (ref. 9) is 



where K is the ratio of the velocity of the prey to the velocity of the pursuer. 
Put y' = p to obtain the first-order separable equation 



KVT+7^={a-x)y 



KVl+p=ia-x)^ 



which can easUy be solved (section 2.3) to obtain 



dy_ ^_J_ 
dx ^ 2 




If 7^ 1, this equation becomes, upon integration. 



C,{K-l) 



X 




(L{K=l, the integration yields a logarithmic term.) 
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4.1.2 Independent Variable Missing 



The general form of the second-order equation in which the independent 
variable does not appear explicitly is 

We again define p by 

dy 

P-t (4-11) 
Then substituting this together with the relation 

dx^ dx dy dx dy ^ ^^^^^ 

into equation (4-10) shows that p is determined by the first-order differential 
equation 

f(fp,P,r)=o 

Suppose that this equation can be solved and its integral is 

/(P» y) = Ci = constant (4-13) 

It is again possible to proceed in two different ways. First, suppose that it is 
easier to find a formula for the solution p = g{y^ Ci) of equation (4-13) for p 
as a function of y. Then combining this with equation (4-11) and integrating 
provides a general solution 



C2 = X 



of equation (4-10). 

On the other hand, if it is easier to find a formula 



y=h(p,Ci) (4-14) 
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for the solution of equation (4^13) which expresses y as a function of p, equation 
(4-12) shows that 

dx_l d^^l dh 
dp p dp p dp 

But this equation can be integrated by parts to obtain the equation 

:3c = C2 + -/i(p, Cx) + \—Mp, Cx)dp (4-15) 
P J P^ 

which, together with equation (4-14), determines the solution to equation (4-10) 
parametricaUy. 

For example, the differential equation 

cPy fdyY 



.(|)' = 0 (4-16) 



occurs in the field of fluid dynamics.^^ Substituting equations (4-11) and (4-12) 
into this equation yields the first-order equation 

Since ihis equation is separable, it can be integrated to obtain p = C\ly. 
Hence, combining this with equation (4-11) and integrating shows that 

r_=c,x+C2 
p+i 

is a solution of equation (4-16). 

Notice that, when and D are constants, the differential equation 



^ More specifically, it governs the. velocity field in a boundary layer in the neighborhood of the separation point. 
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does not explicitly contain the dependent variable x. When the procedure 
just described is applied to this equation, we encounter integrals which usually 
cannot be evaluated in terms of elementary functions. These integrals, however, 
can always be expressed in terms of elliptic functions. The differential equation 
is therefore called the elliptic equation. For more details concerning the proce- 
dures involved in evaluating these integrals and the properties of elliptic 
functions, the reader is referred to reference 10 (chapter 6 and section 11 of 
chapter 7). 

Finally, notice that a linear homogeneous equation does not contain the 
independent variable explicitly if, and only if, it has constant coefficients.^^ 

4.1.3 Homogeneous Equations 

The gt.. eral definition of a homogeneous function of degree k has been 
given in section 2.3. We shall now show that if the second-order differential 
equation (4-1) has certain homogeneity properties, it can be solved by ele- 
mentary means. 

4.1.3.1 Equations homogeneous in the dependent variable and its deriva- 
tives.— Firsts suppose that equation (4^-1) is homogeneous of degree k in the 
variables y, y', and y"; that is, it satisfies the homogeneity condition 

F{ty\ty\ty,x)--t'F{y\y\y.x) (4-17) 
for any number t. Hence, if we put t— 1/y, equation (4-17) becomes 

which shows that the differential equation (4^1) can be written in the form 

F(AAl,rcUo (4-18) 

by factoring out y^. In order to reduce the order of this equation, define the 
function a(:c) by 



We assume that the rea<ier knows how to solve linear equations with constant coefficients. 
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(4-19) 

y 



Then 



y" 



Upon substituting this, together with equation (4-19), into equation (4-18) 
we obtain the first-order equation 

Fiu'+u\u,L,x)=0 (4-20) 

Suppose this equation c "n be solved and its integral is 

f{u,x)=Cx (4-21) 

Then solve equation (4-21) for u as a function oix to obtain 

u=g{x,Ci) (4-22) 

But substituting this into equation (4-19) and integrating shows that the 
original equation (4-1) has the solution 

In y= ^g{x, Cy)dx+C2 (4-23) 

If the differential equation (4-J.) is linear, the first-order equation (4-20) 
obtained by this method wiU be a Riccati equation which ^vill usually be 
more difficult to soWe than the original equation. 

As an example M the method, consider the equation 

F(y',y',y,x) = yy"-y'^ + fx=0 (4-24) 

and replace y, y', and y" by ty, ty' , and ty" , respectively, to get 

{ty) {ty") - {ty'Y + (ty^x^ tHyy" -y'^+y^x) = t^F(y", y\ y, x) 
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This shows that F is homogeneous of degree 2 in y and its derivative. Hence, 
upon introducing the transformation (4-19), the differential equation (4-24) 
becomes 



But this equation can be immediately integrated to obtain 



Hence, 

In y= j(Ci—^dx + C2 
The solution to equation (4-24) is, therefore, given by 

y = C3 exp (Cix — ^ 

v'Mere we have put C3 = e^2. 

4.1.3.2 Isobaric equation. — The isobaric equation of the first order in 
normal form was encountered in section 2.3. In the general case, the function 



jpf d^y ch^^y dy \ 



is said to be isobaric if there exist numbers k and / such that 
V dx^'^ dx^-'' " " "'^ dx'^^'^V 

for all values of t. And the differential equation 

81 



ERLC 



DIFFERENTIAL EQUATIONS 

is said to be isobaric if the function F is isobaric. It is easy to see that the dif- 
ferential equation (2-17) is of this type (for m=l). For the second-order dif- 
ferential equation 

F(y\y\y.x) = 0 (4-26) 

the condition (4-25) becomes 

F(t^-^y\ t^-^y\ t^y, tx) = t^F{y\ y\ y, x) (4-27) 
Thus, in particular, upon replacing t by \\x^ equation (4-27) becomes 

^(^, i)=^/^(y", y, y, ^)=o 

And this shows that equation (4-26) can be written in the form 

f(|^,^,|^,i) = 0 (4-28) 

However, when we introduce the new variables 

u = x-^y (4-29) 

and 

^ = ln (4-30) 
into this equation, we obtain an equation 

(2Z-1) ^+/(/-l)a,^ + Zu, a, l] = 0 (4-31) 

in \vhich the independent variable ^ does not appear explicitly. Since this 
equation can always be reduced to a first-order equation by the methods of 
section 4.1.2, it follows that the isobaric equation of the second order can also 
be reduced to such an equation. 
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The homogeneous linear isobaric equation of the second order is an equa- 
tion of the form 

x-y' ' ^-p^y' + 9oy = 0 (4-32 ) 

where Po and are constants. It is known as the homogeneous Eider equation. 
Since this equation satisfies condition (4-27) with l = k = 0^ the change of 
variables u = y^ ^=\n x will transform it into the equation 

^+(po-l)^+9o« = 0 

The independent variable does not appear explicitly in thU equation and the 
coefficii;nts are constants.^® 

This equation, therefore, has two solutions of the form u = e^^, one for each 
pf the roots of the equation. 

C2+(po-l)C + 9o=0 
It is easy to see that the general Euler equation 

x^y ' + Pox/ + qoy= r{x) 

can also be transformed into an equation with constant coefficients by the 
change of variables 

u = y ^ = ln:r = 

A less elementaiy exampl^^^an isobaric equation is provided by the 
equation 

Fiy",y',y,x)=yy"-ly'^ + (^iy = 0 (4-33) 

It is easy to verify that, when the function F is given by equation (4~33), the 
condition (4~27) will be satisfied for any value of / provided that k=2l — 2. 
Hence, upon introducing the change of variables 



-^^Which is as it should be since the equation is linear. 
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(4-34) 

the diflferential equationi (4-33) is transformed into the equation 

"^+(2~0"^-4(^) -^(2-0 " ^'-''^ 

Since in this case any value of / can be used, we choose its value to 
simplify equation (4-35). This is accomplished by setting whereupon 
equation (4-35) becomes 

d^H 3/duY ^ 

But this is a special case of equation (4-16) with ^'=— 3/4 and, therefore, has 
the solution 

4ai/4==Ci^+C2 



Hence, by using equations (4-34) and (4r-35), the solution to equation (4r-33) 
is found to be 

4 j 

4.1.4 Method of Voriation of Parameters 

This method applies only to linear equations. We have seen in chapter 1 
that the homogeneous equation (associated with eq. (4-4)) 

y'+p{x)y + q{x)y=0 (4-36) 

possesses exactly two linearly independent solutions in any interval in which its 
coefficients are continuous, and that the general solution of the nonhomoge- 
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neous equation (4^4) in this interval is the sum of any particular solution of that 
equation plus an arbitrary linear combination of two linearly independent 
solutions of (4-36). 

We now suppose that by some means a nontrivial solution yn of the asso- 
ciated homogeneous equation (4—36) has been found. Substituting 



(where t; is a function to be determined subsequently) into equation (4—4) and 
using the fact that y// satisfies the homogeneous equation (4-36) io simplify 
the result shows that 

yHv"+{2y„+pyHW^r 



But this is a first-order linear equation for v\ It can therefore be solved by the 
methods of section 2.3, to obtain 



When this equation is solved for v' and integrated, we obtain an expression for 
V (in terms of known functions) which contains two arbitrary constants. Hence, 
substituting this expression into y—ynv gives the general solution to equation 
(4-4). 

For example, it is easy to find by inspection that yn—x is a homogeneous 
solution of the equation 



Hence, substituting y=xv into this equation shows that v' satisfies the first- 
order linear equation 

2 /_£E1±3 
i; ■ V — 

which can easily be integrated to obtain 
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a;2 + 1 

But solving this equation for v' and integrating shows that v is given by 



Therefore, the general solution to equation (4-37) is 

y=:ct;= Y+ Ci - 1) + Cz^c 

4.1.5 Equalicns Invariant Under a Transformation Group 

The group-theory method for reducing the order of equations is a generali- 
zation of all the techniques previously discussed in this section. However, tKis 
technique cannot be applied routinely since, as will be seen, it is necessary to 
find a group under which a given equation is invariant and there is no con- 
structive procedure for accomplishing this. The method is more useful for 
working backwards to find general methods for solving particular classes of 
equations by starting with a given group and testing equations for invariance 
under this group in much the same way that equations are tested to see if they 
are homogeneous. 

A single parameter Lie group^^ in two dimensions is a family of coordinate 
transformations 



(4-38) 



which the members of the family are individuated by the values of the param- 
eter a. In addition, the family must contain an identity txansformation which, 
without loss of generality, we can associate with the value a: = 0. Thus 



Various continuity hypotheses, which wiU not be presented here, are required for a rigorous treatment of the 
theory. 



86 



ELEMENTARY METHODS FOR SECOND-ORDER EQUATIONS 

x = f{x,T. 0) 

y=gf(^»y;0) 

Consider an ^finitely differentiable but otherwise arbitrary function of the 
coordinates F{x^ y). If the point {x^ y) is transformed by the group (4-38) into 
the point {xujxi for a particular value of a, the value of F at {x\^y\^ is given 
by the Taylor series whose leading terms are 

= FU, y) +a 1^ ^U, y) ^ \ iq{x, y) ^ j F{x, y) + . . 



(4-39) 



where we have put 



In particular, if F is taken successively as x and y, then 

xi = x + a^{x, y) + . . 
yi=y+a7){x, y) + . . 



(4-41) 



When a is infinitesimaUy small, the transformation (4-41) differs only infin- 
itesimaUy from the identity transformations; therefore, ^ and 7} are referred to 
as the infinitesimal transformations of the group. The operator 

U^Hx.y)j^+r){x,y)j^ 

is called the infinitesimal operator of the group. By using this operator notation, 
the Taylor series (4-39) can be expressed as 

F{xuyi) = F{x,y)+aUF+^a^U^F+. . . 
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But this series can be formally summed to obtain 

In the particular cases where F is taken to be the coordinates themselves, this 
becomes 

These equations are equivalent to the equations (4-38) which define the original 
finite transformation. This shows that the finite transformation is completely 
determined by the infinitesimal transformations. 

In order to illustrate these ideas, consider the magnification group 



Xi^f{x, y; a) = e«ac 

yi=firU. y; «) =e«y 



(4-42) 



It is apparent that we obtain the identity transformation when «=0. Inserting 
the equations of this group into equations (4-40) shows that the infinitesimal 
transformations of this group are 



and therefore that the infinitesimal operator is* 

U = x- — ry— 
dx by 

Applying this operator repeatedly to the coordinates yields 
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Ux=x Uy^y 



Hence, 



x\=-'X + oiX+^a^x+-^a^x+ , 



— .yi'=y+(xy+^a^y+j^a^y+ . . . 
And upon summing these series, we obtain the original group 

xi = €"x yx^e^y 
The differential equation 

G{x,y,y\y')^Q (4-43) 



is said to be invariant under the group (4-38) if introducing the new variables 
x\ and yi, given by equations (4-38), into this equation leads to the equation 

G{xuyuy[.y[')^0 

This means that the change of variable given in equations (4-38) does not alter 
the form of the differential equation (4-43). 
For example, the differential equation 

GU, y, y, y") ^xy"-F(^, y')=0 (4-44) 

is invariant under the magnification group (4-42) since it follows from equations 
(4-42) that 
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X Xi^ dx dxi^ dx^ ^ dx\ 



We state without proof that a necessary condition for the differential 
equation (4-43) to be invariant under the group (4-38) is that 

£/oG=0 (4-45) 

v/here the operator f/o is defined by 

with 

^ dx dx 

and 

^ dx^ ^ dx ^ dx^ 

In performing the partial derivatives we treat x, y, y', and y" as independent 
variables; whereas, in performing the total differentiations we treat these 
quantities as functions of x. 

For example, since we have shown that 

i=x r\ = y 

for the magnification group (4-42), it follows that 
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for this group. The operator is, therefore, given by 



[/e=xf + y|- . (4-46) 

dx dy 



But since 



applying the operator (4-46) to equation (4-44) shows that 

f/oG = - y — + y — = 0 
dy ^ by 

which is consistent with the result obtained in the previous example. 
We have shown in chapter 3 that the system 

dx ^ dy ^ dp 
^{x,y) y){x,y) i{x,y,p) 

has two functionally independent integrals, u{x^y) and t;(:)c,y,p), one of which 
can be chosen independent of p. The following result allows us to apply the 
ideas of group theory to reduce the order of a differential equation: If the 
differential equation {4-43) is invariant under the group {4-38), then the 
equation obtained by introducing the integrals u and v as new variables in this 
equation is the first order. 

Thus, w 0 have seen in the preceding examples that equation (4—44) is 
invariant under the magnification group (4-42) and that, for this group, 

^:=^x T7 = y ^ = 0 x = 0 

Hence, the system (4-47) becomes 

dx_dy_ dp 
X y Q 



^°We have written P'=y\ 
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which has the two functionally independent integrals 



But since 



we see that 



y 

u = - and v^p 

X 



j,_ dp _dv _ dv du _ dv ip y\ 
dx dx du dx du \x x^J 



J, dv y V 



Hence, upon introducing the new variables a and v into equation (4-44), we 
get the first- order equation 

dv F(u^ v) 
du u — v 

It is easy to see that equation (4-44) is the general isobaric equation 
with /=1. For this case the group-theory method is the same as the method 
given in section 4.1.3.2. In fact, all the methods of solution given up to now 
in this chapter are equivalent to the group theory method when used in con- 
junction with certain well-known groups. 

For example, the equation with the dependent variable missing, treated 
in section 4.1.1, is invariant under the translation group 



And the equation with independent variable missing, treated in section 4.1.2, 
ie invariant under the translation group 

Xi^'x + a 

yi = y 
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The isobaric equation with /=0, treated in section 4.1.3.2, is invariant under 
the afline group 

And the homogeneous equation treated in sectiAn 4.1.3.1 is invariant under 
the afiine group 

X\=X 

The general linear equation discussed in section 4.1.4 is invariant under the 
nonuniform-distortion group 

X\=X 

y\ = y'^0L^\x) 

where is any homogeneous solution of the equation. 

In each of these cases the group-theory method is entirely equivalent to 
the method already introduced. 

4.1.6 Exact Equations of the Second Order 

We introduced the exact equation of the first order in section 2.2, We 
shaU now extend the ideas presented therein to the second-order differential 
equation 

F(/\/.y.^)=o (4-48) 

We say that the differential equation (4-48) is exact if there exists a function 
<^>(y'» y» ^) such that 

F = f (4-49) 
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Suppose that such a functicn (j) exists. Then every solution of equation 
(4-48) must also be a solution of the first-order differential equation 

<t>iy\y.^)'^Cx (4-50) 

for some constant d. Hence, the problem of solving equation (4-48) can be 
replaced by the problem of solving the first-order equation (4-50). We can 
therefore say that equation (4-48) has been reduced to the first-order equation 
(4-50). Upon recalling the definition givea in section 1.3 we see that is a 
(first) integral of equation (4-48). 

It follows from the chain rule that 

where the variables y, and y' are treated as independent in forming the 
partial derivatives. Hence, it follows from equation (4-49) and the fact that 0 
does not depend on j ' that the differential equation (4—48) must be an 
equation of the form 

Fif. y\y. x) --fix, y, y)f+g(x, y, / ) = 0 (4-52) 

where 

f{x,y,p)--4>p (4-53) 

fir(:t, y, p) = <f>x+p^y (4-54) 

It is now easy to verify by substituting in equations (4-53) and (4-54) that/ 
and g satisfy the conditions 



fxx + 2pfxy + P%y = gxp + PSyp " gy ] 
fjrp + Pfyp + 2fy — gpp 



(4-55) 



r 

** A» usual, we h«ve put The subscript not.tion for parti.) derivatives is beine used. 
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We have therefore shown that, if the general second-order equation 
(4-48) is exact, it must be of the first degree and, hence, of the form (4-52). 
And the functions / and g in this equation must satisfy conditions (4-55). 
Then the equation will have a first integral <}> (and therefore can be reduced 
to a first-order equation) which can be found by integrating equation (4-53) 
with respect to p (at constant x and y) to obtain 

<f>=j f{x.y.p)dp + h{x,y) (4-56) 

where h is an arbitrary function which arises from the integration. Now if 
the differential equation is exact, it will always be possible to determine the 
function h so that, when equation (4—56) is substituted into equation (4-54), 
the latter equation will be identically satisfied. 

In order to illustrate the method, consider the equation 

F{y\y\x)^xyy'-i'xy'^ + yy' = 0 (4-57) 



For this equation the functions /and g (in eq. (4-52)) are given by 

g=z xy^ + yy' = xp^ + yp\ 



(4-58) 



It is easy to verify that these relations satisfy conditions (4-55). Hence, equa- 
tion (4-57j is sn exaci equation. 

Substituting the first of equations (4-58) into equation (4-56) shows that 

</)=p:cy+/i(:x:,y) 

and substituting this and the second equation (4-58) into equation (4-54) 
shows that 

xp^ + yp = yp'^hx+ p^x +phy 
But this equation is satisfied by taking A — constant. Hence, equation (4-57) 

95 



ERIC 



DIFFERENTIAL EQUATIONS 

has the first integral 



</> = p^y = y'^y = C\ (4-59) 



where Ct is a constant. But this first-order equation is separable and can be 
integrated immediately to obtain the general solution 

^ — Cilnx + Cy 

of equation (4-57). 

Sometimes a first integral of an exact equation can be found by inspection 
simply by collecting terms and writing the equation in the form (4-49). Thus, 
since 

__ yy =y2^yy 

the differential equation (4-57) can alsc be written as 

F{y\y.x)=^x£{yy') + {yy')^0 



or 

F{y\ y, x) xyy = 0 

Hence, 

0 = xyy' 

which is ihe same as equation (4-59). 

The general linear equation (4-3) is of the form (4-52) with 

f(x, y. >') ^ po(x) 

and 

fi(x, y, v') = P\{x)y' + />2(^)y-- />3(^) 
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The second condition (4-55) for exactness is automatically satisfied; and the 
first condition is satisfied if, and only if, 

____ + ^, = 0 (4-60) 

And when this is the ease, equation (4-56) becomes 

^ = pMp^Hx, y) 
But substituting this into equation (4-54) shows that 

/(/po , bh 

Hence, it follows from equation (4-60) that 

A[(f-,„),+ *]. + A[(f|._,„),,,],,,.o 

It is easy to see that thi.s equation will be satisfied when h is given by 

^^^^ " ^ ~ / /^^(^^^'^ 

Hence, we have shown that the first integral of the general, linear, exact 
equation is 



This is a linear first-order equation and can, therefore, be solved by the methods 
of section 2.3. 

J»!Si as in the case of first-order equations, we can sometimes find an 
integrating factor tjCx, y, y') for an equation of the form (4-S2) which is not 
exact. Thus^ a function T)(y\ y^ x) is an integrating factor of equation (4-52) if 
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r)F = 0 



is an exact equation. 

For example, Liouville's equation 

y" +giy)y'^+fix)y'-=0 
is not exact; but, upon multip ying tlirough by tj— 1/y', we obtain the equation 



^y"+^(y)y'+/U) = 0 (4-61) 

which can be written as 

^[In y' + Y(y)+X{x)]=0 

where K(y) = / g{y)dy and X{x) = / f{x)dx. 

Equation (4-61) is therefore exact and its first integral is 



0 = ln y' + Y+X^Co 

But, upon putting Ci = e^o, we obtain the separable equation 

y' €^ =^Cie~^ 

which can be immediately integrated to obtain the general solution 



to Liouville^s equation. 

Let pn{x), Piix), and Pzix) be the coefficients of the linear homogeneous 
equation 
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pof+piy+p^y^o 



(4-62) 



and let 7){x) be a nonlrivial solution of the equation 



poV'+(2p;-Pi)v+(Po-p;+P2h=o 



(4-63) 



which can also be written as 



(l?Po)"- (7)Pl)' + 1?P2 = 0 



(4-64) 



Since equation (4-60) is a necessary and sufficient condition that equation 
(4-3) be exact, equation (4-64) shows that '.he equation 



is exact. But this implies that j) is an integrating factor for equation (4-62). 
The linear homogeneous equation (4-63) for the integrating factor 17 is known 
as Jthe adjoint equation of equation (4-62). 

4.2 EQUATICNS WHICH ARE EQUIVALENT TO A LINEAR EQUATION 

4.2.1 Equations Which Can Be Transformed Into a Third-Order Linear Equation 

In section 2.4, we have seen that the first-order Riccati equation could 
be transformed into a second-order linear equation by the change of variable 



where h{x) in nol identically zero in the interval of interest. 

Since linear equations are generally much easier to solve than nonlinear 
equations, the additional complexity incurred by raising the order of the equa- 
tion is often justified. We shall now show that the change of variable (4-65) 
transforms the second-order nonUnear equation 



y"+p{x)y'-3h{x)yy' =^f{x) +g{x)y+ ih'{x)+p{x)hix)]f'-hHx)y^ 

(4-66) 



ivPo)f+ {vPi)y+ (T7.'>2)y=0 



y{t)kix)dx 



(4-65) 



u 
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where p{x), h{x), and g{x) can be any functions x, into a linear equation 
of the third order. To this end we differentiate equation (4-65) three times in 
succession to obtain 

u'=—yhix)u (4-67) 
u"=^{y'h'-y'h + yh')u (4-68) 

u"'=-/l^y"+3/iyy'+^y'+^y-3y2A' + /l2yjja (4-69) 

Substituting for y" from equation (4-66) into equation (4-69) gives 

u'''=-h^(2!^-py+{^^+gy+f+{ph-2h')y^y 

And using equation (4-68) to eliminate y' in this equation gives 

Hence, it follows from equation (4-67) that u satisfies the third-order linear 
equation 



u'" +pAx)u" + q,ix)u' + rdx)u = Q (4-70) 



where 



Px{x)=p-2j^ 
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For example, consider the equation 



y"+3yy' + y^ = 0 



(4-71) 



This equation is of the form (4-^), with p=/=g=0 and /t = — 1. Hence, 
Pi = 9i = Ti = 0, and equation (4-70) becomes 



which can be substituted into equation (4-67) to show that equation (4-71) 
has the general solution 



where we have put bi = CilC> and 6o = Co/C2. 

4.2.2 Equations Which Are Equivalent to a Second-Order Linear Equation 

Wc shall now consider a class of second-order nonlinear equations H'hose 
solutions can be expressed in terms of the solutions of second-order linear 
equations. The work on this problem began with Painleve (ref. 11) and was 
carried on by Herbst (ref. 12), Gergen and Dressel (ref. 13), and Pinney (ref. 14). 
We shall present only the results here without proving any of the assertions. 
The references given should be consulted for details. Thus, for any functions 
w{x) and q{x) ofxy any function Y{y) of y, and any constant a, the differential 
equation 



But this equation has the solution 



a = Co + Cix + C2X^ 



2x+b, 



x^ + biX + bi, 




(4-72) 



has a solutioit of the form 



(4-73) 
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^/c^here 0 is the inverse of the function 9 defined by 



e(y)=exp|j^ (4-74) 

(that is, O[0(y)] ^y) and the function co is given by 

o) = Ciu\ + Cziil + CzUxUi (4-75 ) 

where Ci, C2, and C3 arc constants and U\ and Uz are two linearly independent 
solutions of the linear differential equation 

u"-^u'-q{x)u = Q (4-76) 
For example, consider the equation introduced by Painleve (ref. 11) 

y"+^y'-'+f{x)y'=g{x)y (4-77) 

where 6 is a constant and / and g are any functions of :t. This is a special case 
of equation (4-72) with (1 -F )/y= 6/y, w'/w^-f, a = 0, and 9= il + b)g{x). 
Hence, we can take y==y/(6+l) and equation (4-74) becomes 



(9=exp[(6+l)|^j=exp[(6+l) In yj=y<^ 
Therefore, 

0(0) = 9i/(6+i) 

In this case the differential equation (4-76) is 

a" +fu' - (1 + b)gu^O (4-78) 
And the solution to equation (4-77) is given by 
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y = e(w''2)= (0,1/2)1/(1 + 6) = (C,Zif + C2Zi|-hC3ii,Ji2)l/[2(l + 6)] 

(4-79) 

where at and it% are two linearly independent solutions of equation (4-78). 
It can be verified by direct substitution and by applying equation (4-78) that 
equation (4-77) wiD be satisfied if, and only if, 

C3 = 2VCT VC^ 
Hence, equation (4-79) becomes 

y=(VC^a, + VcIu2)»/<*"*^ 

But since Ui is also a solution of equation (4-78), this is equiva- 

lent to taking y = + &> where u is a general solution of equation (4-78). 
Next consider the equation (ref. 14) 

y"+p(^)y+^r^=o (4-80) 

where p{x) is any function of x and Af is a constant. This is a special case of 
equation (4-72) with w= constant = Co, K=y, ^(;c) = — p(jc), a=^M\C\. 
Hence, 6l(y) = y and, therefore, its inverse is 6(0) = 0. But this shows that 

y=6 (o)l/2)=zcol/2=(CiU2 + C2U| + C3UiU2)>/2 (4_81) 

where U\ and are linearly independent solutions of 

a"+p(jc)u = 0 (4-82) 

Let J denote the Wronskian of the solutions u\ and ui\ that is, 

J^iLxu!^-u\u% (4-83) 

Upon differentiating equation (4-83) with respect to x and using the fact that 
U\ and U2 satisfy equation (4^82), we find that"*^ 



^* Or sec section 5.9. 
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dx ^ 

which shows that 7= constant. Substituting the solution (4-81) into equation 
(4-80), using equation (4-82), and using the fact that its Wronskian is constant, 
we find that equation (4-81) is a solution of equation (4-80) if, and only if, 

4.3 MISCEUANEOUS METHODS 

4.3.1 Change of Voriables ^ 

Frequently, a good choice of new dependent and independent variables 
will convert an equation to a simpler and more easily analyzed form. Some pro- 
cedures which have proved helpful for this purpose are ^ven in this section. 

4.3.1.1 General transformation of linear equations. --The second-order 
linear equation (4-3) is transformed by introducing a new dependent variable 
V which is of the form 

i^=/(x)y (4-84) 

and a new independent variable t which is of the form 

t==^gix) (4-85) 

into an equation which is also linear and of the second order. 

The change of variable (4-84) transforms the linear homogeneous equation 

y +P(^)y' +qix)y-=0 (4-36) 

into an equation 

i;" +Pi ixW+qi{x)v=-0 (4-86) 
of the same type. It is clear that equation (4-56) can be transformed back into 
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the original equation (4-36) by a change of variable which is also of the form 
(4-84). Any two equations which can be transformed into one another by a 
change of variable of the type (4-84) are said to be equivalent. The new coeffi- 
cients Pi{x) and qi {x) of equation (4-86) are related to the original coefficients 
p{x) and q{x) by ' 

1 ; 1 o 1 , 1 o 

^^2^ -4^ ==^^""2^^ ^4^' 

Hence, we may say that the quantity 

y^q-\p'-\p' (4-87) 

remains invariant under the transformation (4-84). It is therefore called the 
invariant of equation (4-36). We have seen that any two equivalent equations 
have the same invariant. It can also be shown that, conversely, any two equa- ' 
tions with the same invariant are equivalent. 

If the solution of one equation of the form (4-36) is known, it is possible 
to find the solution of all equations which have the same invariant. Thus, when 
a new equation is encountered, we can compare its invariant with those of 
equations whose solutions are known. If we can find one which is the same, 
we will have succeeded in solving the original equation. In particular, the ad- 
joint equation (see section 4.1.6) of equation (4-36) has the same invariant 
as equation (4-36) and is therefore equivalent to it. _ 

If the coefficient p{x) in equation (4-36) is identically equal to zero, we say 
that the equation is in normal"^^ form. In this case the invariant (4-87) is given by 

y=^q 

In the general case the equation (4-36) with invariant (4-87) can always be 
transformed into the normal equation 

v'' + jfv=^0 (4-88) 

by a change of variable of the form (4-84). Then equation (4-88) is said to be the 



^Notice that in this case the meaning of term normal is different from that of section 1.4. The proper interpret 
tation of this term should always be clear from the context. 
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normal form of equation (4-36). It is clear that any given equation has only one 
normal form and that all equivalent equations have the same normal form. 
The normal differential equation 

can always be transformed into the normal equation 

by changing both the dependent and independent variables by transformations 
of the types (4^84) and (4-85), respectively, provided the nonlinear differential 
equation 



j -^^^^ - 1 ^ j -^^^^ - 2 ^ ^+4 i ^ j 

can be solved for the new independent variable t. When this is the case, the 
function / in equation (4-84) which determines the new dependent variable is 




A fuller discussion of this topic as well as proofs of the various assertions 
made in this section can be found in Rainville (ref. 15, chapter 1). 

4.3.1.2 Transformation to an equation with constant coefficients.— We 
have seen that the homogeneous Euler equation (section 4.1.3.2) can be trans- 
formed by a change of independent variable into an equation with constant 
coefficients (which we know how to solve). More generally, the linear homo- 
geneous equation 

y'+p{x)y + q(x)y=^ 0 (4-36) 

can be transformed into a linear equation with constant coefficients by a change 
of independent variable if, and only if. 



106 



ELEMENTARY METHODS FOR SECOND*ORDER EQUATIONS 




constant 



(4-89) 



When condition (4-89) holds, the change in variable (4-85) is given by 



where c is any constant. 

In order to prove this, it is only necessary to substitute the change in vari- 
able (4-85) into equation (4-36) and obtain the transformed equation 



It is now easy to see that the coefficient of y in this equation will be constant 
if, and only if, t is given by equation (4^90). Further, substituting (4^90) into 
the coefficient of dy\di^ we find that this coefficient wiU also be constant if, 
and only if, condition (4-89) is satisfied. 

Thus, for example, for the homogeneous Euler equation, p{x)~polx 
and g{x) = qolx^. Hence, equation (4-89) is satisfied, and equation (4-90) for 
the new independent variable becomes in this case 



The change of variable (4-30) given in section 4.1.3.2 is a special case of this. 

4.3.1.3 Interchanging of dependent and independent mrmft/e^.— Differ- 
entiating the identity 




(4-90) 



cPy ^ dx^ ^ dx dy ^ g 
df (dt Y dt (dt Y 






dx \dy) 



with respect to x shows that 
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dx" df\dy) 

And when these relations are substituted into the general differential equation 
(4-1), we obtain the equation 

d^x ( dx\-^ I dx\-^ 1 ^ 
--d^Kjy) \-dy) '^'^J = « 

in which x is the dependent variable and y is the independent variable. Some- 
times this change of variable will result in an equation whose solution is 
known or can be found. 

4.3.1.4 Legendre transform. — The Legendre transform which consists 
of introducing the new independent and dependent variables p and re- 
spectively, defined by 

P=| (4-91) 

,=.|-r (4-92) 

can be used to radically alter the form of a differential equation. It follows 
from these relations, after differentiating equation (4-92), that 

dq = xdp + pdx — dy dy^ pdx 

And when these equations are solved for x and y, we find that the inverse 
transformation is given by 



X = 



dq 
dp 



dq 



(4-93) 
(4-94) 



But it follows from equations (4-91) and (4-93) that 
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Hence, substituting equation (4-91) and equations (4-92) to (4-95) into 
equation (4-1) yields the transformed differential equation 



which is also a second-order equation. If a solution q = f{p) of this equation can 
be found, it can be substituted into equations (4-93) and (4-94) to obtain the 
parametric equations 

y=p/'(p) -fip) 

x=f'(p) 

of a solution y of equation (4-1). 

4.3.2 Equation Splitting 

When equations which are split in some natural way into sums, quotients, 
or products of terms, such as 

/(y"ry',y, x)+g{y",y',y,x) = 0 

or 

Ay\y',y,x) _^ , 
giy',y',y,x) 

are encountered, it is sometimes possible to obtain a solution by putting 

n/.y\y,x) = h{x) =-giy',y',y,x) 
for equations of the first type and 
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fiy\y\y.x)=^ch(x\ 
g{f.y\y.x)--h{x) 

for equations of the second type. If h{x) can be chosen so that a common 
solution to the pair of equations can be found, this solution will also be a 
solution of the original equation. 

4.3.3 Tables of Differential Equations and Solutions 

Two valuable catalogs of solutions to differential equations can be found in 
the volumes by Murphy (ref. 16) and Kamke (ref. 17). Murphy lists over 2000 
solved equations which are classified according to order and degree; Kamke 
gives about 1500 equations along with their solutions and references to the 
literature. 
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CHMERS 

Review of Complex Variables 



A general procedure for solving second-order linear equations will be 
given in chapter 6. But this procedure involves the use of power series, and 
the discussion of power series becomes much simpler when it is carried out 
in its natural setting— the complex plane. In order to take advantage of this 
fact we shall extend the definition of a differential equation given in chapter 1 
to include the case where the variables which occur in the equation are complex. 
Thus, by considering a more general situation we are actually able to simplify 
the treatment. Another reason for making this extension is that it allows us to 
see how solutions are connected across the singular points of the equation. 

In this chapter, those concepts from the theory of functions of a complex 
Variable which are needed for this purpose will be reviewed* The treatment 
is essentially descriptive; and rigorous proofs of the various assertions are, 
for the most part, omitted. For a more detailed treatment of the topics covered 
herein (including the omitted proofs), as well as a more complete coverage of 
the vast field of complex variables, the reader is referred to the many excellent 
texts which are devoted entirely to this subject. 

5.1 COMPLEX VARIABLES 

Let X and y be two independent real variables and, as is the usual practice, 
put 1= V— 1. Then z = x + iy is Qomp^^^ variable. It is frequently convenient 
to think of the values of z as points in a plane, called the complex plane^ whose 
Cartesian coordinates are x and y. 

**A good elemenUry treatment is given /by Churchill (ref. 18). A more advanced and theoretical treatment is 
given by Ahlfors (rcf, 19), while the text by (Carrier, Krook, and Pearson (ref. 20) emphasizes advanced applications. 
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X 



Figure 5-1. — Polar representation of complex number 2. 

Instead of using t he Cart esian coordinates x and y, we can also use the 
polar coordinates r= Vx^+y^ and 0=tan*"^ y/x to locate points in this plane. 
(The relation between the polar and Cartesian coordinates is illustrated in 
fig. 5~L) Then 

z = x+iy= r cos 0+ir sin 6 

Asid upon using Euler's formula, we obtain the polar representation 

z=r (cos 6+i sin d) = re*^ 

of the complex number 2. Notice that for « = 0, ±1, ±2, . . . 

e'2"'^=cos 2n7r + i sin 2nTr=l 

Hence, 

The definitions of a domain and a neighborhood have been g?ven in 
section 1.1 for a general n-dimensional space. We shall continue to use these 
definitions in the two-dimensional complex plane* 
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The complex conjugate of the variable z is denoted by 2* and defined by 

The absolute value or modulus of the complex variable z is defined to be 
the length of the vector joining the origin with the point z in the complex 
plane and is denoted by \z\. Therefore,**^ 

\z\ = Vjc2 + y2 = 



5.2 ANALYTIC FUt^aiONS OF COMPLEX VARIABLE 

Let u{x, y) and v{x^ y) he any two real-valued functions^^ (of the variables 
X and y) which are defined in some re^on of the complex plane. Then w = u+ iv 
is a complex-valued function oi x and y. Since w associates a complex number 
with each point z=x-\-iy of some re^on of the complex plane, we say that 
w is a function of the complex variable z. 

We shall consider only a particular class of functions of a complex variable 
called analytic or holomorphic functions. In order to define this class of func- 
tions we first introduce the concept of a complex derivative. To this end, let 
m; = u + It; be a function of the complex variable z and suppose that x and y are 
changed by the amounts Ax and Ay, respectively. Then w changes by an amount 
Au; = Au + / At;. Now, by analogy with the definitions of the derivative of a 
real-valued function of a real variable, we define dwldz^ the derivative^'^ of w 
with respect to z at tfie point 2, to be the limit 

dw Au + iAv Au' 
-ir*=lim -T — , =lim -r — 
dz ajt-^o Ajc + 1 Ay 



provided that this limit not only exists but that it is independent of the manner 
in which Ajc and Ay approach zero. When Ajc and Ay approach zero in some 
prescribed manner, approaches zero along some path in the complex plane. 



<> Satice thai \z\ is equal la the [nAar <<Mirdinate n 

4« Recall lhat arccirding tc» the conventi«»n aduptrd in srctinn LI we assume that all functiims are fiinfje valued 
unless explicitly stated otherwise. 

*^We shall frequently write u ' (z) or tv' in place diddz and m^^Hz) or ii^"' in place itf d^uifh" (or n = 1,2, . . . 
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y 



z + Az 




Figure 5-2.— Typical path along which Az can approach zero. 



as indicated schematically in figure 5-2. But the definition implies that, if 
w is to have a derivative at the point z, then ^wJAz must approach the same 
limit for every such path along which Az approaches zero. Although this 
requirement imposed on the complex derivative may seem unimportant, its 
implications are enormous. In fact, by allowing Az to approach zero along 
various paths, it can be readily shown (ref. 18, p. 34)1 that, if u and v are con- 
tinuously differentiable,"*^ a necessary and sufficient condition for the ex- 
istence of the derivative dwidz at the point zo is that u and v satisfy the two 
Cauchy-Riemann equations 



at this point. This shows that much greater restrictions are imposed on those 
complex functions which possess complex derivatives in the sense of the 
definition given above than are imposed on the real functions which ppssess 
ordinary real derivatives. However, since the complex derivative is formally 
the same as the real derivative, the usual rules for differentiating sums, prod- 
ucts, quotients, etc., still apply (ref. 18, p. 31). 

A function w(z) of the complex variable z is said to be analytic^^ or holomor- 
phic in a domain D if it possesses a derivative at every point of Z). Frequently, 



**Thi8 means that the partial derivatives du/dx,du/dy,dr/dac, and dr/dy exist and are continuouR. 
1 he terms regular and monofifnic are also used. 



du_dv 
dx dy 



and 



du 
dy 



dx 
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when it is of no consequence in the discussion, the reference to the domain Z) is 
omitted and we simply say that the function w{z) is analytic. A function is 
said to be analytic at a point zo if it is analytic in some neighborhood of this 
point. 

Notice that the identity function 

iv = z = x+ iy 

is analytic at every point since the Cauchy-Riemann equations (with u = x and 
v = y) are always satisfied. However, the complex conjugate of this function 

m; = z* = X — iy 

is not analytic at any point since in this case du/dx= 1 and dv/dy = '- 1 and 
therefore the Cauchy-Riemann equations are never satisfied. 
The real and imaginary parts of the function 

1 1 z* jc — iy 

w = - = 



are 



x+ iy zz^ A:2 + y2 



u = -=^r-: — - and v = ^ 



x^ + y^ x^ + y^ 

respectively. And upon taking the partial derivatives of these functions we see 
that the Cauchy-Riemann equations are satisfied at every point except z=0, 
where the partial derivatives fail to exist. Hence, w = 1/z is analytic at every 
point except z = 0. 

Il is a remarkable fact (see ref. 18, p. 122) that any function w{z) which is 
analytic at a point zo possesses derivatives of all orders at this point. And these 
derivatives are themselves analytic functions at this point. It is easy to see that 
the sum and product of any two analytic functions are analytic within any 
domain iii which both functions are analytic. Usually, any function which is 
obtained from a real algebraic, elementary-transcendental function (trigono- 
metric, exponential, logarithmic, etc.) or a common higher-transcendental func- 
tion {Bessel function, hypergeometric function, etc.) by replacing the r^al 
variable x by the complex variable !ry=x+iy is an analytic function wichin some 
domain. 
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5.3 CONFORMAL MAPPING so 

According to the definition given in section 5.2, a complex function 
w=u+iv of the complex variable z = x + iy associates a pair of numbers 
(u^v) with each point of some region of the complex z-plane. We can 

interpret these numbers as coordinates of a point in a complex M;-plane. Thus, 
we may think of the function w{z) as a transformation ov a mapping of some 
region in the z-plane into some region in the i^-plane. More specifically, we 
can think of an analytic function iv{z) which is defined on a domain D in the 
2-plane as a mapping of D onto a region R in the i^z-plane, as shown schematically 
in figure &-3. In order to determine the properties of an analytic function w{z) 
it is frequently helpful to study the manner in which this function transforms 
various points, curves, or domains in the z-plane into corresponding points, 
curves, or regions in the w-planie. 



y V 




X ' u 



Figure 5-3, • Mapping of Z) onto R by w(z). 



Thus, the transformation w=\lz associates a single point in the i^;-plane 
with each point in the z-plane except the ori^n 2 = 0. It maps all those points 
lying outside the circle with radius 7? and center at the origin in the z-plane 
into the interior of the circle with radius IjR and center at the origin in the 
M;-plane. Although there is no point of the z-plane which maps into the point 
m;=0, we can, by choosing R sufficiently large, make the points outside this 



A <'ompreh<^nsive trt»atmem of this subject can be fnund in Nehari (ref. 21). 
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circle map into a circle of arbitrary small radius about w=0. However, it is 
frequently convenient to "complete" the z-plane by adding a fictitious point 
z = Qo which maps into the point w=0 under the mapping w^ljz. Thus, when 
we speak of the behavior of an equation or a function at the point 2=00, we 
actually mean the behavior at the point w=0 of the transformed equation or 
function obtained by putting z=llw. When it is necessary to distinguish 
between the point 2=00 and the other points of the complex plane, the latter 
are said to be finite points. When the complex plane includes the point 2=00, 
it is called the extended plane; and when 2 = 00 is excluded, it is called the 
finite plane. 

Let w{z) be analytic in a domain D and let 20 be any point of D at which 
dwjdz 7^ 0. Then w(z) transforms any two smooth curves passing through 20 
in such a way that their image curves intersect at the point i(;o=w;(2o) with 
the same angle (in both magnitude and sense of rotation) as the original curves 
in the 2-plane (ref. 18, p. 174). Thus, the mapping "preserves angles," and we 
say that w{z) is a conformal mapping at all points where dwidz # 0. 

A mapping which is particularly useful for the treatment of certain types 
of linear differential equations is the linear fractional transform 



tv= , I (5-1) 
cz+a 

Notice that, if arf— 6c=0, this transformation reduces to t«;= constant. In 
any other case, it transforms each point in the extended 2-plane into a point 
in the extended w-p\ane in such a way that no two points in the 2-plane map into 
the same point in the w;-plane. In addition, there is a point in the 2-plane which 
maps into each point in the M;-plane. For this reason, we say that a linear frac- 
tional transformation with arf — 6c 7^ 0 is nonsingular. 

If we consider straight lines and points as being degenerate circles (i.e., 
circles having infinite or zero radii), we can say that the linear fractional 
transformation always maps circles into circles. 

Performing two nonsingular linear fractional transformations in suc- 
cession is equivalent to performing a single nonsingular linear fractional 
transformation. In fact, any nonsingular linear fractional transformation can 
be performed by carrying out not more than four successive transformations 
each of which has one of the three elementary forms 



w= ocz (rotation and stretching) (5-2) 
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w=(3 + z (translation) 



(5-3) 



w — - (inversion) (5~4) 
z 

In order to prove this, first suppose that Ct^O. Then equation (5-1) can 
be written as 




(5-5) 



Now {ransform the z-plane into the fi-plane by the transformation 




Then transform the fi-plane into the f2-plane by 

1 

t2 = - 

and the ^2-plane into the^^a-plane by 




Finally, transform the ^3-plane into the w-planie by 

a , 
w = — h^3 
c 

Upon combining these successive transformations we obtain equation (5-5) 
and therefore equation (5-1). This proves the assertion for the case where 
c # 0. When c = 0, equation (5-1) reduces to 
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a ■ b 
a a 

which is easily seen to be equivalent to the succession of transforms 

a , 6 

ti = -jZ and w = ti + ^ 
a a 

If the transformation (5-1) is to be nonsingular, at least two of the con- 
stants a, 6, c, and d must be nonzero. By dividing through by one of these, 
it is easy to see that equation (5—1) in fact contains only three arbitrary con- 
stants. It is therefore not surprising that these constants can always be chosen 
so that the linear fractional transformation maps any three given points in the 
z-plane, say zi, Z2, and za, into any three given points, say Wii Sind w^^in 
the ti^plane. Thus, for example, the linear fractional transformation which 
takes z = Zi into w=0^z = Z2 into zi; = 1 , and z = za into w = ^is 

Z2 — Z3 Z — Zi 

w= 

Z2~Zi z — Z3 



5.4 ISOLATED SINGULAR POINTS OF ANALYTIC FUNCTIONS 

If a function w{z) is analytic at every point in some neighborhood of a 
point zo except at the point zo itself, then zo is called an isolated singular point 
or an isolated singularity of the function w{z) . Thus, the function 

"'^"^ ^ icfrf)^ 

has isolated singulaiities at the points z = 0 and z = —1. 

An isolated singular point zo of the function w{z) is called a removable 
singularity if the limit of w{z) as z — > zo is equal to some finite number. Let k be 
a positive integer. An isolated singular point zo of the function w{z) is said to be 
a pole of order k if the limit as z->zo of the quantity (z— zo)'^w;(z) is equal to 
some finite nonzero number. A pole of order one is called a simple pole. 



^' The function need not even be defined at the point zo. 
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Thus, for example, the function given by equation (5-6) has a simple pole 
at z = 0 and has a pole of order two at z = — 1 . 

Because of the way analytic functions arise in practice, it turns out that we 
sometimes arrive at a function w{z) which is not defined at a point zo but is 
defined and analytic at every point of a neighborhood of zq. The point zo is 
thus an isolated singular point of w{z). But if this point is also a removable 
singularity, the function can be made analytic at Zo simply by assigning a suit- 
able value to w{z) at this point (ref. 18, p. 158). For example, since division by 
zero is undefined, the function w{z) given in equation (5-6) is undefined at 
z = 0. Thus, OX w{0) is also undefined. Hence, the function ^(z) defined by 

^(z) = zw{z) 

is not defined at the point z = 0. However, upon defining ^(0) by 



^(0) -]im^(z) = 2 

we obtain a function which is analytic at z = 0. 

It is easy to see that, if w (z) has a pole of order k at zo, the function 

Uz) ^ {z-zo)^w{z) 

has a removable singularity at zo and is therefore "essentially" analytic at this 
point.52 shall sometimes say that an analytic function has a pole of order 
zero at the point zo if zo is a removable singularity of this function. 

Any isolated singular point of an analytic function which is not a pole or 
a removable singularity is called an essential singularity. For example, the 
function sin(l/z) has an essential singularity at z= 0. 

There are some important differences between poles and essential singu- 
larities. For example, if w{z) has a pole at zo, the function l/w;(z) is analytic 



For the purposes of this book we can assume that any analytic function which is encountered has already 
been defined at its removable singularities in such a way that it is analytic at these points. 
*3 In fact, it is equal to zero at zo (see preceding footnote). 



120 



REVIEW Of COMPLEX VARIABLES 



at Zo; but if w{z) has an essential singularity at 20, so does l!w{z) (ref. 22, p. 
110). A pole, then, is a point where a function w{z) is not analytic only because 
its modulus \w{z) \ becomes infinitely large at this point and for no other reason. 

A function which is analytic at every finite point of the complex plane is 
called an entire function. And Liouville's theorem (ref. 18, p. 1.25) states that 
any entire function which is also analytic at infinity (see section 5.3) must, in 
fact, be equal to a constant. 

A polynomial is a function of the form ao + aiz + . . . + anZ^ where 
ao, . . . , an are complex constants. It is an entire function, and it has a pole 
of order n at infinity. A rational function is the ratio of two polynomials (which 
may be chosen to have no linear factors in common). It is therefore a function 
of the form 

/ ^ _ao+ai Z+a2Z^+ . . . +anZ» ,^ . /c ^\ 

■ r _L A 2-L — m a„ 7^ 0; 6m 7^ 0 (5-7) 



and is analytic everywhere in the finite plane except at those points where its 
denominator is equal to zero. These points are poles of w{z). If n, then 
wiz) is analytic at the point 2=^); otherwise it has a pole of order n — m at 
this point. 

A function which is analytic at every point of a domain D except at those 
points of D where it has poles is said to be meromorphic in D. For example, 
the rational function (5-7) is meromorphic in the entire finite plane. In fact, 
any function which is meromorphic in the entire finite plane and has a pole at 
infinity is necessarily a rational function (ref. 20, p. 60). A function which is 
meromorphic in the entire finite plane can have at most a finite number of 
poles in any domain D ofi finite size. However, it may have infinitely many 
poles if Z) is infinitely large.^"* 

In view of Euler's formula (see section 5.1) it is natural to define the func- 
tion by the formula 

g2r=ex+ii/=gx cosy+ ie-^siny 

Then is an entire function and has an essential singularity at 2 = 00. We can 
now define the functions sin 2 and cos 2 by the formulas 



For example, D could be the enlire olane or the upper half plane. 
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sin 2 




and 



cos 2 = 



2 



which extend in a natural way the definitions ^ven to these functions when 
the variables are real. They are also entire functions with essential singularities 
at 2= CO. On the other hand, the function 1/sin z is meromorphic in the entire 
finite plane; and its poles are located at the points z^nn for n = 0, ±l,±2, 
etc. It also has an essential singularity at 2=00. 



in which the coefficients an can be any complex numbers. This series certainly 
converges at the point 20, which may be the only point at which it actually 
does converge. Or the opposite extreme could occur and the series might 
converge at every point of the finite plane. In all other cases the series will 
converge at every point within a circle of radius R and center at zo, called the 
circle of convergence of the series, and will diverge at every point which lies 
outside this circle. Thus (ref* 19), there exists a number R lying in the range 
0 ^ i? < cx) called the radius of convergence of the series such that the series 
(5-8) converges at all points 2 which satisfy the inequality^* I2— 2o( <R and 
diverges at all points 2 which satisfy the inequality I2— 2o| > R* The question 
of whether the series is convergent for the points which satisfy the equality 
I2 — 2o| = /? (i.e., points on the circle of convergence) is more subtle but un- 
important for our purposes. 

A power series with a nonzero radius of convergence R converges to an 
analytic function and can be differentiated term by term (i.e., the order of 
summation and differentiation can be interchanged) at every point within its 
circle of convergence. Thus, there exists a function w(z) which is analytic at 
every point within the circle j2— 26| < R such that 



^ The series is, in fact, absolutely convergent at these points. Th^^ means that the Ueries still converges when 
each of its terms is replaced by its absolute value. See r^f. 19 formore details. 
This resale was first established by Abel. 



5.5 POWER SERIES 



A power series about a point zo is an infinite series of the form 



00 



]£ a„(2 — 2o)" 



(5-8) 
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U! 



iz) = J; aniz-zo)' 



n=0 



dz 



3C 



for Iz— zol < R 



It can also be shown (ref, 19) that, when the series (5-8) has a nonzero 
radius of convergence /?, there exists a positive constant M such that for 
any number 0<r<R the coefficients of the series satisfy the Cauchy estimates 



M 



for n = 0, 1,2,,,. 



This result will be used in the discussion of the solutions of differential equa- 
tions in the next chapter. 

Now suppose that v/(z) is analytic in the domain D and that zo is any 
point of D. Then the power series 



|;^m;<''>(zo)(z-zo)'' 



li>0 



(where uf^K^o) = U){z)) converges to w(z) at every point z within the largest 
circle centered at zo lying entirely within D (ref. 18, p. 129). This series is called 
a Taylor series expansion of w{z) about zo. Its radius of convergence is at least 
equal to the shortest distance between zo and the boundary of D. It may be 
larger than this but we have no guarantee that the series will converge to w{z) 
at points which lie outside of D. The series representation (5-9) is unique in 

the sense that if ^ 6fi(z — zo)" is any power series which converges to w{z) 

within any circle about zo, then necessarily (ref. 20, p. 49) 

bn^—, /x/"K2o) for n = 0, 1,2,... 

nl 

Next, suppose that w{z) is analytic at every point of a domain D except 
for a certain number of isolated ^singular points and let zo be a point of D at 
which w{z) is analytic. Then the circJe of convergence of the Taylor series 
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(b) 



(a) Circle of convergence does not intersect boundary of D, 

(b) Maximum circle of convergence intersects boundary of D, 

Figure 5-4.— Circle of convergence of a Taylor series. 



of tv(z) about zo passes through the nearest isolated singular point of w{z) 
if it does not intersect the boundary of D. In this Utter case we can only assert 
that the radius of Nj^onvergence does not exceed the distance between zoand the 
nearest of the isolated singularities of tv{z) within D. These results are illus- 
trated in figure 5-4. Thus, in particular, if the function w{z) is analytic at every 
finite point of the complex plane except at a certain number of isolated singu- 
lar points, then the circle of convergence of its Taylor series expansion about 
any point zo where w{z) is analytic always passes through the nearest isolated 
singular point to zo. 

For example, we have seen in section 5.2 that w{z) — is an entire 
function. It is easy to see that the nth derivative of this function is 
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w^'*\z)-=e' for n =0,1,2,, , 
Hence, the Taylor series expanision of about 2 = 0 is 



e-=5;^z« (5-10) 



And this series converges in the entire finite plane. 

We have also shoMrn in section 5.2 that the function w{z) = 1/;: is analytic 
at every point of the complex plane except the origin 2 = 0. The nth derivative 
of this function is 

Hence, its Taylor series expansion about the point 2=1 is 

(-D'-u-i)" 

It is easy to verify that the radius of convergence of this series is equal to 1 
and that the circle of convergence passes through the isolated singular point 
2 = 0. Upon replacing 1 — 2 by 2 in this series we obtain the geometric series 

^ ^ 71 = 0 

which converges within the unit circle \z\ = 1. This circle passes througli the 
isolated singular point 2 = 1 of the function (1 — 2)-^ 

We shall frequently find it necessary to add and multiply two power 
series. The sum of two power series about the same point can be obtained 
by adding the two series term by term. The resuUing series will converge 
within the smaller of the two circles of convergence of the original series 

(ref. 23, p. 123). Now let V Cn ai^d V dn be any two absolutely convergent 
Any expression for the product Cn^ <fn^ must certainly include 



series 
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all terms of the type Cidj. But all terms of this type must belong to the array 

Codo+Codi +Cod2 +. . . + Codn + . . . 
+ Cido +Cidi +dxdt + * . . + Ci^/„ + . . . 
+ Czd^ + ctdx + Czdz + . . . + Czdn + . . . 



+ • • . 

And the series which is formed by grouping together the terms along the di- 
agonals of thi§ array and summing the result over all diagonals is called the 
Cauchy product of the two series. Thus, the general term in the Gauchy 
product is 

ft n 

Gn^" CndQ+ Cn^ldi + Cn~2d2 + . * . + Co^n = V Cn^kdk^ V Ckdn^k 

and the Cauchy product is the series ^ an* Cauchy's theorem (fef. 18, p. 147) 

n-O 

States that the Cauchy product ^ an is absolutely convergent and that 

The Cauchy product is particularly convenient to use when multiplying 
power series. For, in this case, we get 

fy Qniz-Zo^] \f bn{z-Zo)A = f V ak{z - Zo)^bnMz " ZoV''^ 
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which converges within the smaller circle of convergence of the two ori&nal. 
series. 

For example, let us use these ideas to find the power series expansion of 
the function l/[(a--z)(6— z)], where a and 6 are arbitrary complex constants. 
To this end notice that the geometric expansion (5-11) implies that 

1 

6 

Hence, upon forming the Cauchy product we obtain 

(T- r) (6 - 2) " S6 t„ ^" ti (o) U) 



and 



a 



But since 

'J\ n+l /JX n+I 



a b 

we find that 

1 \ ^ 

{a^z){b-z) b-a^^'' ^ 

Next, in order to find the Taylor series expansion of the function cos z/(l + z^) 
about the point 2=0, notice that by changing variables in the geometric expan- 
sion (5-1 1)» we obtain the expansion 

and that by using the expansion (5-9) and the definition of cos 2 given in section 
5.4, we obtain the expansion 
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Then, upon taking the Cauchy product of these two series, we obtain 

We have seen that a power series (with positive exponents) represents 
(converges to) an analytic function within a circle. Similarly, the series (ref. 
18, p. 134) 

S "niz-zo)" (5-12) 

containing both positive and negative exponents, converges to an analytic 
function in an annular region lying between two concentric circles centered 
at zo and of radii /?, and i?2 with Ri < R2 (i.e., at all points 2 for which 
|z— zo|</?2). Conversely, any function m;(2) . which is analytic in an 
annular region /?i < |z — zoj < Rt can always be represented by a series of 
the form (5-12) at every point of this re^on. This expansion is called a Laurent 
series. An important special case occurs when the function wiz) has an isolated 
singularity at the point zo and is analytic at every other point within the circle 
U — 2o| = /f. In this case the series 

W{Z)== 2) «n(2-2o)" 
n= -oc 

converges to w{z) at every point 2 of the punctured circular region 
0< \z'-zo\<R bounded by the circle I2— 2o|==/f and the point 2a. Then the 
isolated singularity zo ^5 a pole of order k of the function w(z) if and only if 
a^ij 7^ 0 and — 0 for all n < — k. Hence, if 20 is an essential singularity, 
infinitely many negative powers of 2 — 20 will occur in the series. 

For example, we can use the geometric series (5-*ll) to obtain the expansion 



Pruvided it converprs at slL 
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^—1 2 1 
Z 

of the function (2 — about the point 2 = ^c. This series converges at all 
points which lie outside the circle == L And since the series 

converges w/lhin the circle \z\ = 3, we conclude that the series 

22 ^1.3^ « 

(2-l)(3-2)""^^--r 3--2 2. 



with 



converges in the annular region 1 < (2! < 3. 
5.6 COMPLEX INTEGRATION 



for « = — 1 , ^ 2 , . . . 
for n = 0, ^, 2, . . . 



Let w{z) be analytic in a domain Then the integral tv{z)di, of w;(2) 

along a curve or path V which lies entirely within D is defined in terms of two 
real line integrals along V by 

tv(z)(h = (mix - vdy) + i {udy+ vdx) (5-13) 



It as easy to verify from this definition that the usual rules of integration 
sti^l apply. Thus, in particular, if a and /3 are complex constants and iv\{z) 
and iviiz) are analytic functions 
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j [awi{z) + fiw2{z)]dz=^aj Wi{z)dz+ p j W2(z)dz 

and if the direction of integration along F is reversed, the integral is multiplied 
by-1. 

For example, the integral of the function w{z)=^z along the line yo= con- 
stant, from the point (0, yo) to the point {xo, yo), is 

f f^^ f^^ 1 1 

Izdz^j^ xdx+i\ yodx^'^+iyoxo^-{xo + iyo)^-'^{iyoy 

In order to integrate w{z)—z along a circular path centered at 2=0, it is best 
to use polar notation. Thus, let the radius of the circle be R. Then on this circle 
2=/?e'^ and dz^iRe'^dO. Hence, 



f zdz=i f 

Jr=R Jo 



27r 

R^e^^^dd^O 



Moro generally, it can be shown (reft 18, p. Ill) that, if C is any closed curve 
within D and if iu{z) is analytic at every point in the interior of C, then 



w{z)dz^O 

Therefore, if Fi and F2 are any two curves in D which begin at the point zi and 
end at the point 22 (fig. 5-5), then 



J U){z)dz=^ I w{z) 



az 



provided 11^(2) is analytic within the domain enclosed by these curves. 

Because of this fact the exact path along which the integration is carried 
out is frequently unimportant; and when this is the case, we write 

j 7v{z)dz in place Jp ^{z)dz. 

The function w{z) = I/2 has a singular point at the origin; and its integral 
along the circle of radius R centered at the on&n is 
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(a) 



(b) 



(a) Line integrals along T, (b) Line integrals equal along 

and r2 not necessarily Tj and 

equal. 

Figure 5-5. — Paths for line integral. (Arrows indicate direction of integration.) 

f 'dz^i \ dd=2m 

Jr=R Z Jo 

If the function w(z) is an analytic function of z in Z>, the function F(z) de- 
fined by 



F(z 



) = ( w{z)dz 



is also an analytic function of z in D and (ref. 18, p. 114) 

dFjz) _ . . 
-^-w{z) 

Hence, 

F{z)-F{z,)=^V F'{z)dz 

This shows that just as in the case of real variables, integration and differen- 
tiation are inverse processes. For example, in order to evaluate the integral 

I z"dz notice that, for n 7^ —1, 

JZ9 
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n + l dz 

Hence, 



7 dz ^ 

az n + l n+\ 



It can also be shown (ref. 18, p. 141) that any convergent power series can 
be integrated term by term and the resulting series wiU have the same circle 
of convergence as the original series. In fact, it can be shown that the product 
of any convergent power series about a point zo with a function of the form 
(2--2o)^, where X is a complex constant, can also be integrated term by 
term. 



5.7 ANALYTIC CONTiNUATiON 



5.7.1 Definition 



First, suppose that W\{z) and w^z{z) are both analytic in some common 
domain D. It can be shown (ref. 18, p. 259) that i/ Wi(z)= W2(z) at all points of 
some subdomain of Dor even at all points of some curve which lies entirely within 
D, then wi(z) and W2(z) are equal at every point of D. This assertion is known 
as the fundamental theorem of analytic continuation. It means that there is 
only one analytic function in a domain D which takes on any given set of values 
which are prescribed at every point of a subdomain o/D or even at every point 
of some curve in D. For example, if the function w{z) is analytic in a domain/) 
and is equal to zero at every point of a subdomain of D or at every point of a 
curve lying within Z), then w{z) is zero at every point of D. 

We have seen in section 5.5 that the analytic fuT?:Ction 



1^7 ■ (5-14) 



which is defined and analytic at every point of the complex plane except 
2=1 can be expanded in the Xayior series 

i 2" (5-15) 

n=0 
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Figure 5-6. — Domains for direct analytic contination; Dc is the common part of both domains 

Di and Do. 



which converges only within the unit circle. Thus, the function (5-15) is de- 
fined only within the unit circle, where it is equal to the function (5-14), 
which, however, is defined in a much larger region. The function (5-14) can 
therefore be considered as an extension of the function (5-15) from the unit 
circle to the entire complex plane with the point z = 1 excluded. Indeed, 
whenever an analytic function is defined by some expression (such as a power 
series) in some domain D which is not the whole complex plane, it is natural 
to ask if this function can be extended to a larger liomain. 

First, consider the function Wi{z) defined on the domain Di and let D2 
be another domain, part of which coincides with Di as shown in figure 5-6. 
It can be shown that the common region Z)c, which is part of both domains, 
is itseK a domain and h::.ice is a subdomain of both the domain Di and the 
domain D2. Now suppose that there exists a function W2 which is analytic 
in the domain D2 and which is equal to Wi{z) at every point z of the common 
domain Dc. Of course, the function u^iz) may not exist. However, if it does 
exist, it is called the direct analytic continuation of the function Wi to the 
domain D2. 

There can be at most one direct analytic con tin uation of a function to any 
given domain. For if (,2 is another direct analytic continuation ofwi to Z)2, then 
W2 and ^2 are both analytic in D2 and are equal to one another in the subdomain 
Dc. Hence, the fundamental theorem shows that 102 and ^2 are equal at every 
point of D2. And this of course means that ^ and 102 are the same function. 



^^See, e.g., ref. 8, ch. l.The domains D] and D2 are said to intersect; and the common domain Z>c« called the 
intersection of ^1 and £>2, is denoted by Di O D2, 
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Let b be the domain which consists of all points which belong either to 
the domain Di or the domain D2, or both.^^ Then since the analytic functions 
Wi{z) and W2{z) are equal at all points where they are both defined, we can. 
define a new analytic function w{z) on the domain D by the relation 



w{z) = 



Wi (z) for z in Di 
^ W2{z) for z in D2 



It is clear that the analytic function w{z) is an extension of the analytic func- 
tion wi (z) from the domain Di to the larger domain D. 

The process described above does not have to terminate with the function 
W2{z). It may, for example, be possible to find a direct analytic continuation 
tvs{z) of the function 11^2(2) to a domain Da, and so on. Proceeding in this 
manner we obtain a chain of domains /)2, D^^ . . . such as that shown in figure 
5-7 and a collection of analytic functions W2{z), W:i{z), . . . defined on these 
domains. Each of these functions is said to be an analytic continuation of 
the function W\{z)y and the procedure itself is called analytic continuation. 
We say that Wi{z) is analytically continued along a simple ^^'curve F which ex- 
tends from D\ to some point P if F is completely covered by a chain of domains 
Do, Ds, . . . (as shown in fig. 5-8) along which Wi{z) can be analytically con- 
tinued in the manner described above. 



It is shown in various books on analysis that this extended region is indeed a domain. It is called the union of 
the domains Di and D2 and is denoted by Di U Dz^ e.g., see ref. 8, ch. 1. 

^ Roughly, this means that T is smooth and does not cross itself nor have any other pathological behavior. 
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Figure 5-8. — Analytic continuation along a curve. 

The collection of functions generated by the process of analytic continua- 
tion can be used, as in the case of direct analytic continuations, to define a 
new analytic function on the larger domain which includes all the domains 
on which the analytic continuations are defined^ If, in addition, the function 
U)i{z) is analytically continued along a curve F, the values of this extended 
function on F itself will be the same no matter whieh specific collection of 
domains D2, ZJa, ... is used to construct it. 

5.7.2 Specific Method 

In order to make these ideas more <;oncrete we shall consider a specific 
process which can be used, at least in theory, to obtain an analytic continua- 
tion of any given function. Thus, suppose that the analytic function Wiiz) is 
defined by some expression in the domain Du For example, it may be defined 
by a Taylor series 

= an{z-zi)^ (5-16) 

in which case the domain Di will be the interior of a circle of radius /?i centered 
at the point zu We suppose that R 1 is finite. Choose a point Z2 in the domain Du 
Since an analytic function is infinitely differentiable, we can calculate the 
sequence of derivatives u;^"K^2) for n==0, 1, 2, . . . from the given expression 
for Wi{z) in the domain Dj. For example, when the function W}{z) is given by 
the Taylor series (5-16), M"K^2) can be obtained by differentiating equation 
(5-15), term by term, n times and evaluating the result at Z2. Then as indicated 
in section 5.5 the Taylor series 
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with 

= — — ; — for/i = 0, 1,2, • . . 

will converge to an analytic function in a circle of nonzero radius centered at 
22. And this function will be equal to tVi (z) at every point which is inside both 
this circle and the domain Du Of course, the circle of convergence of u>2(z) 
may not extend beyond the domain Di (as shown in fig, 5-9(a)), If this occurs, 




(b) 



(a) Circle of convergence of tvziz) does not extend beyond Dt. 

(b) Circle of convergence of iv^iz) extends beyond D|. 

Figure 5-9. — Analytic continuation by power series. 
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we ckn choose a new point 22 and repeat the process. However, if the circle 
of convergence of wtU) does extend beyond Di (as shown in fig, 5-9(b)), 
then Wziz) will be an analytic continuation of u;i(2). The process can now be 
repeated by choosing a point 23 'fvhich lies within the circle of convergence of 
W2{z)'^ proceeding to obtain a new Taylor series about this point, and so on. 

It can be shown that any armlytic continuation of a given function, no 
matter how it has been obtained, can also be found by using the method of 
power series just described. It is easy to verify from this that the analytic 
continuatSon of the derivative of an analytic function has the same value at 
any given point as the derivative of the analytic continuation at that point, 
provided they are both carried out along the same curve. This means th^ the 
order of differentiation and analytic continuation can be interchanged. 

5.7.3 Singular taints 

Let wis} be analytic at all points of a domain D except for a certain 
number of isolated singular points. Suppose, in addition, that w{z) is analytic 
on a subdomain Di of D and that tvi{z) is the restriction^^ o[tu{z) to Di. Then 
tvi{z) is analytic on Di and can be analytically continued to any other sub- 
domain of D which does not contain singular points of w(z). As long as the 
analytic continuation of ^^1(2) is carried out along a path which lies entirely 
within />, the value of this analytic continuation at any point of Z) will be equal 
lo the value of u;(z) at that point. However, since the circle of convergence oi 
a power-series expansion of an analj^tic function will pass through its nearest 
isolated singular point (provided that poinS is nearer than the boundary of the 
domain), it can be seen by using the method of power series that the function 
Wi{z) cannot be analytically continued along any curve which passes through 
an isolated singular point of u;(z). (These ideas are illustrated in fig, 5-10.) 

More generally, let Wi{z) be analytic on some domain Di. If this function 
cannot be analytically continued along any simple curve which crosses the 
boundary of Di at the point zo, we say that the point zo is a singular point of 
the function Wi(z). And the preceding remarks show that this definition is 
consistent with the definition of an isolated singular point given in section 5.4. 

Let 2 Oniz—zo)'^ be a power series whose radius of convergence is not 

n=0 



That 19, u'liz) is a fumtion H-hirh is defined only on Di and takes on the same values at each point of Dt as the 
function u iz), 
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X Isolated singular points 
Analytic continuatioa r Analytic continuation 




out 



Figure 5-10. -Illustration of analytic continuation of a restriction of an analytic function. 




^Circle of convergence 
£>f original series 



Figure 5-11. — Analytic continuation past a circle of convergence. 
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equal to zero or infinity. We have seen that this series converges to an analytic 
function w{z) everywhere within its circle of convergence and diverges outside 
this circle. We shall now show that this circle always passes through a singular 
point of w{z). In order to obtain a contradiction, suppose that there were no 
singularities of w{z) on the circle of convergence. Then it would be possible to 
. analytically continue w{z) a finite distance outside this circle everywhere 
around its circumference (as shown in fig. 5-11). These analytic continuations 
could then be used to construct an analytic function wi{z) which is an ex- 
tension of z<;(z) to a larger circle C wliich is also centered at Xo. Now it is shown 
in section 5.5 that the circle of convergence of the Taylor series expansion 
of ivi (z) about zo cannot be smaller than C But it is also shown in that section 
that this extended function ivi{z) must have the same Taylor series expansion 
about Zo as w{z). However, this is impossible since (by hypothesis) this latter 
series diverges outside of the smaller circle. Hence, we must conclude that 
there is a singular point of z<;(z) on its circle of convergence. 

Starting with a given analytic function wi{z) defined on a domain Z)i, we 
can carry out the process of analytic continuation until all possible analytic 
continuations of the function wi{z) have been found. The collection of analytic 
functions generated in this manner can again be used to define a new function 
on the domain which consists of all the domains on which these various func- 
tions are defined. The function obtained in this manner is called a complete 
analytic function. This function cannot be further extended. A point zo is said 
to be a singular point of the complete analytic function if it is a singular point 
of any analytic continuation of Wi{z). And sometimes, when no confusion is 
likely to arise, we shall say that zo is a singular point of the original function 
W\{z) itself. 

5.7.4 Multiple-Valued Functions 

There is a certain difficulty associated with the definition of a complete 
analytic function given in the preceding section. Thus, suppose that the 
analytic function wi{z) defined on the domain Di can be analytically continued 
along the two simple curves Ti and r2 which terminate at the same point p. 



^In section 5,5 we only asserted that the radius of convergence does not exceed the distance between zo and the 
nearest isolated singular point. 
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Figure 5-12. — Paths for analytic continuation of multiple-valued function. 
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as shown in figure 5-12. There is no guarantee that the analytic continuation 
of Wi{z) along Fi will have the same value at p as its analytic continuation 
along But if this occurs, the complete analytic function obtained from 
Wi (z) must have more than one value at the point p. Thus, although up to this 
point we have assumed that all functions are single valued, we must in general 
allow a complete analytic function to be multiple valued. It can be shown 
jef. 19, p. 218) that the analytic continuation along the path Fi will always 
have the same value at the point p as the analytic continuation along r2 unless 
there is a singular point (such as that shown in fig. 5-12) between these two 
curves.^ However, the mere existence of a singular point between the two 
curves does not guarantee that the analytic continuations along the two dif- 
ferent curves will have different values at p. This only occurs when the singular 
point is a branch point. A branch point is a singular point of a function which 
has the property that the function will not return to its starting value upon 
analytic continuation along any arbitrarily small circle which surrounds 
this point. 

Suppose that the single-valued analytic function Wi{z) is defined on a 
subdomain Di of a domain D (see fig. 5-13). And suppose that D neither con- 
tains any singular points ofwiiz) nor is it possible to construct a closed curve 
within D which surrounds a branch point wi (z) . Then it is impossible for any 
two analytic continuations of wi{z) along paths which lie entirely within D to 
have different values at any given point p of Z). Now, in terms of these analytic 
continuations, we can construct on D (in the manner described above) an 
analytic function w{z). Then this function will be single valued. It is an exten- 
sion of Wi{z) from the domain Di to the larger domain D. And the fundamental 
theorem shows that w{z) is the only single-valued analytic function with this 
property. Therefore, when no confusion is likely to arise, we do not distin- 
guish between the two functions w{z) and ivi(z) and we simply say that Wi{z) 
is defined on the larger domain D. 

For example, consider the function ivi{z) defined by 

wi{z)^z^l^ (5-17) 



This result is known as the monodromy theorem. 
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X 



Figure 5-14. — Analytic continuation of function z*'^. 



on a domain Di which includes a portion of the real axis but which includes 
neither the origin nor any portion of the negative real axis, as shown in figure 
5-14. It is easy to verify that equation (5-17) represents a single -valued analytic 
function in the domain Di. In order to proceed it is convenient to introduce 
the polar representation 2=re*^ discussed in section 5.1. Then the function 
(5-17) can be written as^ 

ii;,(rei^) = ri/V<''2 (5-18) 

When the point z is in Di, the argument 6 will always lie in the range 

-7T<e<7r (5-19) 

(Notice that strict inequality signs are used.) Since the formula (5-18) with 
an extended range of 6 determines an analytic function at each finite point of 
the complex plane except r= 0 and since this function coincides with W\{z) 
in we can use this formula to analytically continue w\(z) outside of Z)|. 

" Recall that we have adopted the convention that the square root of a positive real number is always the positive 
square root. 
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Now the origin is a singluar point oiwiiz). Hence, suppose we analytically 
continue this function to the point p along Fu the semicircle with radius R 
in the upper half plane shown in figure 5~14. Then the value of this analytic 
continuation at p is /?»'V^/2> = /?i^^[cos (Tr/2) + i sin (77/2)] = iR^'K But the 
value at p of the analytic continuation along the semicircle r2 is /?W2e-«flr/2) = 
/?*/^[cos (— Tr/2) + « sin ( — Tr/2)3 =— i/?^/^- These analytic continuations of 
the function tvi{z) therefore have different values at the point p. 

If, instead of stopping at the point p, we carry out the analytic continuation 
of Wi{z) first along Fi to the point p and then along T2 from the point p to the 
point q (in the direction opposite to the arrows), we arrive at the value 
/{i/2e<2^/2=-/{i/2. But since the original value of u;,(z) at the point g is R^l^e'^= 

we see that the function does not return to its original value upon ana- 
lytic continuation around this circle. And since the radius R is arbitrary, this 
shows that the origin is a branch point oiwi{z). By making the transformation 
z=llw and taking R arbitrarily large, we can also show that the point at 
infinity is a branch point of this function. And since 2=0 and z=oo are the 
only singular points (and therefore the only branch points) of Wi{z)j this 
function will always return to its original value when it is analytically continued 
around any path which does not enclose the ori^n.^^ 

Now every analytic continuation of Wi (z) can be obtained from the formula 
(5-18) by letting r range between zero and infinity and letting 6 take on all 
values both positive and negative. But, since €^^^^= 1 for /i= 0, ± 1, ±2, . . ., 
we need only consider values of 6 in the range 0o^^<^o+47r (where ^0 
can be chosen as any fixed number) in order to obtain all possible values of the 
function (5-18). Thus, the complete analytic function w{z) obtained from 
Wi(z) is the multiple-valued function defined by 

w{re^^) = r»/2e»«^2 O^r^co; 60^6^60+^ (5-20) 

It takes on two distinct values at each finite point of the complex plane except 
at the origin, which is a branch point. And one of these two values is equal to 
the negative of the other. 



^ It will never return to its origina] value when analytically continuetl once around any path which does enclose 
the origin. 
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(a) 



y 



3- 

0 



(b) 

(a) Branch cut in arbitrary location. 

(b) Branch cut along negative real axis. 

Figure 5-15.— Branch cuts for z^^K 



It is usually undesirable to deal with multiple-valued functions.^^ We can 
avoid doing this by drawing a line connecting the branch point of the function 
z^^^ at the origin with its branch point at infinity, as shown in figure 5-15(a), 
and then restricting the analytic continuations so that they are not carried out 
along any path which crosses this line. Such a line is called a branch cut and 
it is used to prevent analytic continuations from being carried out along curves 
which encircle the origiKv The actual location of the branch cut is arbitrary but 
we may, for definitenesSv assume that it lies along the negative real axis, as 
shown in figure 5-15(b). Then starting with the original function (5-17) (which, 
as can be seen from eqs. (5-=^18) and (5--19), is positive along the positive real 
axis) and analytically continuing this function along all allowable paths in the 
complex plane, we obtain the extended function 



After all, we would not expect a well-defined physical problem to have a solution which is multiple valued. 
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which is single valued and analytic at every point of the complex plane not lying 
on the negative real axis. We can also analytically continue the function which 
is equal to the negative of the original function (5-17) in Di along all allowable 
paths in the cut plane to obtain the extended function 



And this function is also single valued and analytic at every point of the complex 
plane not lying on the negative real axis. The functions Wi and W2 are said to 
be branches of the double- valued function (5-20). Taken together these two 
branches assume all the values of the multiple-valued function and are there- 
fore equivalent to it. Hence, we can deal with a multiple-valued function by 
replacing it with its single- valued branches. 

The complete function in this example is double valued and therefore 
has two branches. However, we also encounter multiple-valued functions 
whieh take on infinitely many values at each point and therefore have infinitely 
many branches. For example, the function w{z) = In z is defined in polar 
notation to be 



In order to obtain the complete analytic function we must (as in the preceding 
example) let r take on all values in the range 0 < r < 00 and d aU real values. 
But since 2= re»^= re'^^^^"^^ if, and only if, n = 0, ± 1, ±2, . . ., this complete 
function must have infinitely many values at each point. And these values 
differ from one another by multiples of 27rL This function also has a branch 
point at the origin and a branch point at infinity. And if the branch cut is 
again taken along the negative real axis, the infinitely many branches tVniz) 
/orn = 0, ±1,±2, . . . of In 2 become 

Wn{re'^)=^^^r+id 0 < r< 00; (2n- 1) tt < 0 < (2n+l)7r 

forrt = 0,±l,±2, . . . 

The branch corresponding to the range — 7r< ^<7r is called the principal 
branch of the logarithm. 



r2(re*'^)=ri/V^/2 



O<r<oo;7r<0<37r 



M;(re^^) = ln re'^=ln r+id 
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The function 2" (where a is some complex constant) can be defined in terms 
of the logarithm by the formula 2«=e"*"^ Hence, the branch points of this 
function can be located only at the origin and at infinity. By using polar notation 
we can express this function in the form 2:«=e"*"''e"'^=r"e'"^. And this shows 
that the complete function is multiple vedued unless a is an integer. In fact, 
it takes on infinitely many vedues at each point unless a is a rational number. 
The various branches of this function nan be formed in the same way as for the 
logarithm. 

In a similar manner, it can be seen that for any finite point 20 the complete 
analytic function associated with (z — zo)" is multiple valued whenever a is 
not an integer. Its branch points are z = Zo and z = oo and its branch cut can be 
taken along any line joining these two points. However, once a branch cut has 
been chosen, the various branches of this function will then be analytic every- 
where in the cut plane. 

5.8 PERMANENCE OF FUNCTIONAL RELATIONS 

Let F(zi, . . ., Zn) be a complex function of the n complex variables 
Zi = xi + iyi^ . ., Zn^^Xn+iyn- If this function can be expanded in a power 
series 

F{zu . . .,zn)= ^ ail, • • ',ainZ\^zi^ • • •4'* 

h in=l 

with complex coefficients a^i, . . ., ai„ and if this series converges in some 
neighborhood of each point in some domain of the 2/i-dimensional space whose 
coordinates are . . ., ^n, yi, . . yn, then we say that F is an analytic 
function of the n complex variables zi, . . ., Zn in Z). This is clearly an exten- 
sion of the definition of an analytic function of a single complex variable given 
in section 5.2. 

Now let F{wi^ • • M^n, z) be an analytic function of the n+l complex 
variables m;i, . . ., Wn^ z for all vdues of the variables Wi^ . . ., ti^n and for 
all values ofz in some domain Z)o- If w;i(z), . . .,Wn{z) are analytic functions 
of the complex variable z (in the usud sense) in some common subdomain 
D of Z)o, then it can be shown (ref. 4) that the function g{z) defined by 
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--Path of analytic 
continuation of 
the functions 
W2(z),...,Wp(z) 



Figure 5-16. — Illustration of permanence of functional identities. 



g{z) =F{wi{z), . . .,Wn{z),z) 

is also analytic in D. 

Now suppose that wi{z), . . Wn{z) are analytic continuations of 
Wi{z)^ • . Wn{z)^ respectively, from D to some other common subdomain 
D of Do and these analytic continuations can all be obtained by analytically 
continuing the functions Wi{z)^ . . Wn{z) along a single curve T which 
lies entirely within Do. (This is illustrated in fig. 5-16.) In addition, suppose 
thatt<;i(2), . . .5 *^2(2) satisfy the equation 

F{wu . . .,wn,z)=0 (5-21) 

at all points z in D. Then by analytically continuing these functions along T to 
D and using the fundamental theorem of analytic continuation given in the 
beginning of section 5.7, it can be shown (ref. 19, p. 210) that Wi{z), . . 
Wn{z) also satisfy equation (5-21) at every point of Z). This is known as the 
principle of permanence of functional relations. Roughly speaking, it means 
that the analytic continuations of the solutions of equation (5-21) are also 
solutions of this equation. 
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5.9 DIFFERENTIAL EQUATIONS IN COMPLEX PLANE 

5.9.1 Definition 

We have already indicated the utility of extending the definition of a 
dijfferential equation to include the case where the variables are complex. To 
this end let . . ti;n, 2) be an andytic function of the n+ 1 complex vari- 

ables . . . , Wn, z in some domain D. Then the /ith-order normal differential 
equation in the complex domain is an equation of the form 

Notice that in writing this equation we imply that its solutions, if they exist, 
must possess complex rlerivatives at all points where they are defined. It is 
also reasonable to require that the solutions satisfy the equation at least on some 
domain in the z-plane. Hence, the solutions to equation (5-22) must be analytic 
functions. This is a much stronger restriction '£han is imposed in the case of real 
variables, where we require only that the solutions be sufficiently difFerentiable. 

5.9.2 Fundamental Theorem 

The following fundamental theorem (which is analogous to that given in 
chapter 1 for the real- variable case) can be shown to hold (ref. 4, p. 119). For 
each point ^1, . . Sn, 20 of the domain D where the function F is analytic^ 
there exists a unique (i.e., single-valued) function luiz} which satisfies the initial 
conditions 

M^(2o)-^l,U;'(2o) = e2, . . .,M/"-'H2o)=e„ 

i 

is analytic^ and satisfies equation (5-22) in some neighborhood of the point zo- 
We shall be principally interested in the (effectively normal) Unear equation 



^+ai(z)^+. . . + an-dz)^+an{z)w+b{z)^0 (5-23) 

where the coefficients ai(z), . . ., art(2), 6(z) are all analytic on some commoiy 
domain Do. This equation is effectively of the form (5-22) with the function F 



itt . ♦ 2o are/i+l complex nuiiiucifr^ 
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analytic on the domain D which consists of all the values of the variables 
W\y . , .,1472 and all the values of the variable z which lie in the domain Do* 
Hence, the fundamental theorem now becomes: For each set of complex 
numbers Ci» . . cind each point zo of Do there exists a unique function 

w{z) which satisfies the initial conditions 

is analytic^ and satisfies equation (5~23) in some neighborhood of the point zo. 

There is also, in this case, an additional result, due to Fuchs (ref. 24, p. 4) 
which asserts that this solution^ w{z\ has a Taylor series expansion about zo 
whose radius of convergence is at least equal to the shortest distance between 
Zo and the boundary of Do* 

Now suppose that w{z) is a solution to equation (5-23) on some suhdomain 
Di of Do. Then the (single valued) function w{z) and all its derivatives are 
analytic on Du Let w{z) be an analytic continuation oiw{z) along some curve 
in Do to some other subdomailn D of Z)o, as shown in figure 5-17. Then since, 
as indicated in section 5.7.2, the analytic continuation of a derivative of an 
analytic function is equal to the derivative of the analytic continuation, we can 
apply the principle of permanence of functional relations to equation (5-23) 




Figure 5-17. — Illustration of analytic continuation of solution to differential equation. 
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to show that the analytic continuation w{z) is itself a solution to equation 
(5-23). Thus y the analytic continuation along any curve lying entirely within 
Do of a solution to equation (5-23) is also a solution of this equation. 
For example, the differential equati(on 

02 6z^ 

has the solution 

W;(2)=zl/2 + 2l/3 

But upon analytic continuation of this solution around any closed path en* 
circling the origin, we obtain the function 

tv^ {Z) =(e2'^*2) + {e^^z) - 2^/2 4. ^21^/3^1/3 

And it is easy to verify by direct substitution that wi (2) is also a solution of the 
equatioii. (In fact, w{z) and w\ (2) are linearly independent.) 

We shall now show that any solution to equation (5-23) which is defined 
on a subdomain of Do can indeed be analytically continued along any curve in 
Z?o. This means that no solution to equation (5-23) can have a singular point 
in Do* The assertion can be proved by assuming that there exists a solution 
w{z) in a subdomain Di of Do which cannot 'i^ analytically continued along 
seme curve F in Do and then showing that this leads to a contradiction. Thus, 
if w{z) cannot be continued along F, there must be a point zi on F as shown in 
figure 5-18 such that w{z) can be continued up to, but not past, this point. We 
can therefore choose a point 22 on the portion of F joining Dt to 21 which is closer 
to 2i than any part of the boundary of Do. Upon analytically continuing the 
solution w{z) along F to 22, we obtain a solution wziz) of equation (5-23) 
in a neighborhoci of 22. And Fuchs' result shows that ti;2(2) can be expanded 
in a Taylor series about 22 that converges in a circle which includes the point 
2|. But this constitutes an analytic continuation of w{z) along F past the point 
2i, which was assumed to be impossible. And this proves the assertion. 

It follows from these results that any solution^® to equation (5-23) in 



^The existence of such a solution is asserted by the fundamental throrem but only in some neighborhood of this 
point. And this neighborhood could be very small. 
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Taylor series expansion 

of W2(2) 



Figure 5-18.— Cominuation of i4;(2) along l\ 



a neighborhood of a point where the coefficients are analytic can actually be 
extended! to obtain a solution to this equation on the entire domain Do on which 
the coefficients are analytic^ However, in order to do this we must, in general, 
allow these solutions to be multiple valued. 



5.9.3 Linearly Independent Solutions 

By using the fnnHampntal theorem given in this sect?on, the various results 
given in section 1.6 for linear equations with real variables can be extended to 
the complex-variable case. Thus, the homogeneous equation associated with 
equation (5-23) 

■j?r+^»(^)^^+ * * • +an-i(2)M; = 0 (5-24) 

possesses n linearly independent (single valued) solutions W\{z)^ . . ., von{z)^ 
called a fundamental set of solutions, in a neighborhood of each point of 
Do. Now let Wp{z) be ^ particular (single valued) solution of equation (5-23) 
in the neighborhood of some point of Do- Then every solution of this equation 
about this point can be obtained by making a suitable choice of the arbitrary 
constants Ci, . . Cn in the general solution m;(2) =Cim;i (2)+ . . . 'hcnWn{2) + 
Wpiz) of this equation. 
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The definition and discussion of linear independence given in section 1.6 
applies with only trivial modification to the case where the functions are com- 
plex and analytic. Thus, in particular, a necessary and sufficient condition 
(ref. 24, p. 13) that n (single valued) solutions tvi{z)^ . . Wn{z) of equation 
(5-24) be linearly independent on a domain Do on which the coefficients are 
analytic is that the Wronskian 



Wt 



tVn 
IVn 



(5-25) 



W2 



w 



not be equal to zero at any point zi of Do. Since wu . . .^Wn are analytic func- 
tions of z, the Wronskian itself is an analytic function of z which we shall denote 
by "^(z). Thus, 

iriz)^W{wi{z), . . ^.wn{z)) 

It is also easy to see that the Wronskian of the analytic continuations of 
Wiiz) , . . u)n{z) along a curve V in £>o is equal to the analytic continuation of 
the function ^(z) along T. 

It can be shown by using the rules for differentiating determinants and by 
substituting in the differential equation (5-24) (ref. 24, p. 12) that satisfies 
the first-order differential equation 



^^^p,{zW (5-26) 

And upon separating the variables and integrating along any path F in Z?o, 
we obtain 

W{z)--ce^l '''''' (5-27) 
where c is a complex constant of integration. 
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Since Pi (2) is analytic in Oo, ats integral J pi{z)dz must also be analytic 

in Do. Hence, in particular, this integral cannot become infinite at any point of 
Do; and therefore the exponential factor in equation (5-27) can never vanish 
in Do^ Thus, ^{z) can only be equal to zero at a point 21 of Do if c = 0. And 
this shows that, if ^(z) vanishes at any point of Do, it must vanish at every point 
of Do. 

In the special case where n = 2, equation (5-27) can be used to obtain an 
explicit formula which determines a second linearly independent solution 
Wziz) to equation (5-24) when one solution wi{z) to this equation is known. 
Thus, when n — 2, we find upon expanding the determinant and rearranging 
4hat 

az \wi / 

And integrating this along any curve in Do yields the formula 

tV2(z)^cwtiz) j ^^^^^)j, r/2 (5-28) 

which agrees with the formula obtained by the method of variation of parame- 
ters in section 4.1. It follows from the way in which it was constructed that any 
solution "^2(2) calcj/lated from this formula will be linearly independent of 
Wt (z). 

More generally, it can be shown (ref. 24, p. 16, example 10) that, if /i-~l 

linearly independent solutions, say wi{z) u;n-i(z), to equation (5-24) 

are known, another linearly independent solution to this equation is given by 



where ifz) is the Wronskian 
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'ff^ 1(2) = W{W\, . . ., Wn-l) = 



W-1 



n-1 



and, for I = 1, 2, . . n — 1» A/sU) is the cof actor of ivp^ in this Wronskian. 
That is» 



aw;?-* 



5.10 NONELEMENTARY TRANSCENDENTAL FUNCTIONS 

We shall have occasion to use two particular nonelementary functions 
of a complex variable called ih^ gamma function and the beta function. First, 
we define the analytic function \ {z) {orM^ z > 0 to be the Eulerian integral 
of the second kind. 



r(z) 



(5-29) 



This integral converges in the right half plane ^ z>0 and diverges for 
:^u^ z ^ 0. It can be shown (ref. 25) that it represents an analytic function in its 
domain of convergence. Although this analytic function is only defined by 
equation (5-29) in the right half plane, it can be analytically continued into the 
left half plane z ^ 0 by using the formula 



r(z)r(i-z) = 



Sm TTZ 



(5-30) 



to compute the values of Hz) for z ^ 0 from its values at points in the 
right half plane. It follows from this equation that r(z) has simple poles at 
z-0,-1,-2, . . . 

Integrating equation (5-29) by parts (with z replaced by z+ 1) shows 
that for .^.z>0 
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Hence, 

r(z+i) = 2r(2) (5-31) 

By successively applying equation (5-31) we find that for any positive 
integer n 

Viz + n) = {z + n - \)r{z + n - I) 

= iz + n-l){z + n-2)r(z+ n-2) 



= iz + n~ l)iz + n-2) . . . iz+l)zr{z) (5-32) 

It is convenient to introduce a special notation for the factor multiplying 
r{z) in the last member of this e^juation. Hence, we define the generalized 
factorial function (z)n by 

(2)0=1 

and 

{z)n^ n C^ + m) 

= 2(z+l)(2 + 2) . . . (2+n-l) for n= 1,2,3, .. . 



(5-33) 



Thus, the symbol iz)n denotes the product of n factors, each factor being 
one larger than the preceding one. For example. 



(7)3=7X8X9 



(i) 
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Notice that when z == 1 in equation (5-33) , we obtain the ordinary factorial 
function since 

1 • 2 - 3 . . . n = n! (5-34) 

By using this notation, equation (5-32) can be rewritten as r{z + n) = {z)nr{z). 
And, therefore, the generalized factorial function can be expressed in terms 
of the gamma function by 

{z)n = ^^7^^ for n = 1, 2, 3, . . . (5-35) 

Since integrating equation (5-29) with 2 = 1 shows that r(l) = l, we find 
from equations (5-34) and (5-35) that 

Vin + 1) ^ n! for n = 1, 2, 3, . . . (5-36) 

This equation is also valid forn = 0 provided we use the usual definition 0!= 1. 

The beta function B{z^ 0 is a function of two complex variables and is 
defined by 

B{z, 0 ^ £ t'-^{l-t)^'^dt (5-37) 

for z > 0 and -^^-^ ^ > 0. Huwevei, ii Is possible to express this function 
in terms of the gamma function since 



r(2)r(0 = ( 1^ e-H'-^dt J ( 1^ e-V-»c/r) 

And upon setting x — r/t^ we can eliminate r from this equation to obtain 
r(2)r(o= ^"'^'''^K/o ^"''^^"'^^) 
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Hence, after chan^ng the order of integration we find that 

r(z)r(0= j ^^"^{j^ e-'^^^^k'^^-hh^ (Ix 
Then by defining ti by ri = f (jc + 1) and eliminating we get 

And after setting jc = f / ( 1 — 0 this becomes 

r(z) ru) - r {z+o £ t^-^ (i-ty-^dt 

But comparing this with equation (5-32) shows that 
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Solution of Linear Second-Order Differential 
Equations in the Complex Plane 

In section 5.9 we extended the definition of a differential equation to 
include the case where the variables are complex. In this chapter the ideas 
presented in that section are used to find the behavior of and, in certain 
cases, to construct solutions to the second-order differential equation 

^ + Pi^)f,+Qi^)^ = 0 (6-1) 

where z is a complex variable and the coefficients p{z) and qiz) are analytic 
functions in some domain D of the z-plane. We have seen that every solution 
of this equation is an analytic function of 2. 

A point at which the coefficients of equation (6-1) are both analytic is 
called an ordinary point of this equation. Thus, every point of D is an ordinary 
point. A point zo which is a singular point of either p{z) or q{z) (or both) is 
said to be a singular point^ of equation (6-1). And if the only singularities of 
p{z) and q{z) which occur at zo are isolated singular points, zo is also said 
to be an isolated singular point of equation (6-1). 

6A GENERAL BEHAVIOR OF SOLUTIONS AT ORDINARY POINTS 

Let zi be any point of D. It was indicated in section 5.9 that equation 
(6-1) will possess two linearly independent (single valued) solutions, wi{z) 
and wziz)^ in some neighborhood of zu These solutions are said to be a funda- 
mental set of solutions. They possess Taylor series expansions about zi, say 

«» Notice that thift definiT^n is consistent with the one given in section 1.5. 
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2 a<')(z 



X 




(6-2) 



whose radii of convergence are at least equal lo the shortest distance between 
Zi and the boundary of D. Since the coefficients cf equation (6-1) can always 
be analytically continued across those points on the boundary of D which 
are not singular points of the equation, it is always possible to extend the 
domain D (in which the coefficients are analytic) in such a way that every 
finite point on its boundary^^ is a singular point of equation (6-1). Hence, we 
can assert that the radii of convergence of the Taylor series expansions (6-2) 
of the solutions W\{z) and wz{z) are at least equal to the distance Ro between 
Z\ and the nearest singular point of equation {6-1). It was also shown in 
section 5.9 that the solutions W\{z) and W2{z) can be analytically continued 
along any simple curve in D and that these analytic continuations are them- 
selves solutions of equation (6-i). Thus, in particular, we can assert that 
the series (6-2) not only converge within a circle of radius Ro but that they 
also satisfy the differential equation everywhere within this circle. 

6.2 GENERAL BEHAVIOR OF SOLUTIONS NEAR ISOUTED SINGULAR POINT 

Suppose that zo is either an isolated singular point or an ordinary point 
of equation (6-1). Then the coefficients p{z) and q{z) of this equation will be 
analytic within the punctured circular domain 0< [z — zo | <i? (shown in 
fig. 6-1) whose radius R is equal to the distance between zo and the singular 
point of equation (6-1) closest to zo. We shall call this domain A. Now 
let Wi{z) and W2iz) be a fundamental set of solutions to equation (6-1) in 
a neighborhood Do of a point z of A. We have seen in section 5.9 that these 
solutions can be extended (by using their analytic continuations) so that 
they satisfy equation (6-1) at every point of A. However, since zo may be 
a singular point and since it can be encircled by a curve such as the curve 
r shown in figure 6-1, these extended solutions can be multiple valued. 



^® Provided D has a boundary. 

^' Other than zo itself. 

" Notice that zo is not a point of A. 
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Figure 6-1. — Contour for analytic continuation of wi and W2, 



In order to deduce the behavior of these extended solutions, v/e shall 
now construct a fundamental set of solutions on A whose structure is particu- 
larly transparent. To this end let the fundamental set Wi{z) and iV2{z) be 
analytically continued from Do counterclockwise around F. This process will, 
in general, yield two new functions of z, say JFi{z) and W2{z) which are defined 
on Do by 



But we know that JFi{z) and W2{z) must satisfy the differential equation (6~1) 
and that every solution to this equation in Do can be expressed as a linear 
combination of the fundamental set of solutions wi{z) and W2{z). Thus, there 
exist complex constants. an, ai2, 021, ^22 such that 



Wi{z)^Wi{€^'''{z-Zo)+Zo) ^ 



(6-3) 



^r2(z)^M;2'(e2^'(^-2o)+zo) . 




(6-4) 
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For example, consider the differential equation 

oz oz^ 

and let zo = 0. A fundamental set of solutions to this equation is Wi = z^l^ and 
W2=z^^^. Upon applying equations (6-3) to these solutions, we find that 

(z) = m;i (e^^^z) = (e2^%) 1/2 =( - l)wi (z) 

and 



And, therefore, the constants which appear in equations (6-4) become, in this 
^^se >_a 1 1= ^U_g 12 =0, a2i = 0^ ^22= e^^^'^^ 

We shall now show (in the general case) how the constants in equations 
(6-4) can be used to construct the desired fundamental set of solutions to 
equation (6-1) on the domain Zi. In order to do this, we first recall from the 
theory of linear equations that the algebraic equations 



(ail — ^)ci + a2iC2 = 0 
ai2Ci + (022 "~ X)c2 = 0. 



(6-5) 



have a nontrivial solution in Ci, C2, provided X is a root of the characteristic 
equation 



ail — X a2i 
di2 a22 — A. 



= — {an + 022) X + (aiia22 ^ ^12021) = 0 (6-6) 



This equation will either have two distinct roots or two equal roots. We shall 
treat these two cases separately. 



This equation was discussed in the example given in section 5.9.2. 
" Thai is, a solution other than ci = C2 = 0. 
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6.2.1 Case I: Roots of Characteristic Equation Distinct 

First, suppose that the two roots of equation (6-6), \i and \2, are distinct. 
Let c[^\ be a set of nontrivial solutions to equations (6--5) corresponding 
to the root \i and c^^\ c^^ be a set of nontrivial solutions corresponding to 
the root A.2. Thus, 

a,2c\'^+ (a22-Xi)4^^ 

and 

(au-X2)42) + a2i42) 
ai2Cp)+ (a22-\2)cf 

Now let Ui{z) and U2{z) be the solutions to equation (6-1) which are 
defined in Dq (and only in Z)o) in terms of the fundamental set w\{z) and 
^^2(2) by 

. = c<,i)m;,(z) + c^^W2{z) (6-8) 

U2{z) = c^^wiiz) + c^^W2{z) (6-9) 

Then it follows from equations (6-3), (6-4), and (6-8) that «i(e2'^'(z-zo) + zo), 
the analytic continuation of tti(z) counterclockwise around F, is given by 

tti(e2'^'(z - zo) + zo) = cV^M^i(e2'^Kz - zo) + zo) + c^'>W2{e''''^{z - zo) + zo) 

= c\'Wi{z) + c^'W2{z) 

= [cS^^an + 4i)a2i]u;i(z) + [c['^ai2 + 41^022] wzlz) 
Hence, equations (6-7a) and (6-8) imply 

ai(e2'^'(z-zo) + Zo) = \ic<,i)m;,(z) + \,4i)m;2(z) = \,«i(z) (6-10) 
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And the same argument shows that the analytic continuation of the solution 
U2{z) around f, U2{e^^{z — zo) + 20), is 

U2 (e2^(2 - 20) + 20) = ^2U2(Z) (6-11) 

The constant Xi is nonzero. If this were not true, equation (6-10) would 
show that Wi(e2'^'(2 — 2o) + zo) is identically zero in Do. But then Ui(e-"'*(z— 20) 
+ zo) could be analytically continued backwards along F to show that ^1(2) 
is identically zero. And since the constants c^^ and c^^ are not both zero, 
equation (6-8) would show that tVi{z) and W2{z) are linearly dependent. But 
this is impossible since Wi{z) and W2{z) are, by hypothesis, a fundamental 
set. Hence, we conclude that Xi 7^ 0. The same reasoning shows that X2 # 0. 
We can, therefore, define two (finite) numbers 81 and 82 by^^ 

8,=jLi„x, &=2^1nX. (6-12) 

and use these numbers to define the two analytic functions/i(2) and/zCz) in 
Do by 



fi{z) = {z-Zo)~^mi{z) 

f2{z)= {z-Zo)-^2U2{z) 



(6-13) 



Since !ihe right-hand members of these equations are products of functions 
which can be analytically continued along any simple curve in A, it follows that 
fi{z) and/iC^) must also have this property. And since (2), zi;2(z), (2 — 2o)~^* 
and (2 — zo)""^* have no singular points in A, it follows from equations (6-8), 
(6-9), and (6-13) that /i(z) and /2(2) have no singular points in this region 
Hence, these functions have no branch points in A. On the other hand, the 
analytic continuations /f(e2"''(z-~zo) +20) of/i(z) for r=l, 2 in a counterclock- 
wise direction around any curve F which encloses 20 are 

/i(e2^<(2-2o)+2o) = (e2'^K2-2o))^^«wKe2'^^(2-2o)+2o) f or T = 1 , 2 



"The condition Xi ^ implies that 5i — 62 is not an integer. 

^® However, the pnwnt zo may be a singular point of these functions. 
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Hence, it follows from equations (6-10) and (6-11) to (6-13) that 

Af 

= iz-Zo)-^iUiiz) =Mz) for 1 = 1, 2 



But this shows that the point zo is also not a branch point of the functions 
fi{z)^ i= 1, 2. Hence, these functions will return to their ori^nal values when 
they are analytically continued around any closed curve in A. And this implies, 
as indicated in section 5.7, that they can be extended to single-valued analytic 
functions on the entire domain A. We can therefore suppose that these ex- 
tensions have already been carried out and that /i(z) and/zCz) are defined on 
the entire dom<jin A. Hence, it follows from equations (6-13) that the extensions 
of the solutions Ui(z) and ^2(2) from Do to the domain A (which we shall 
also denote by ui{z) and U2(z)) are functions. of the form 



Ui{z) = {z-zo)^ifi{z) ^ 

U2{z) = {z-Z(^Y^Mz) 



(6-14) 



where f\{z) and fiyz) are single-valued analytic functions on the entire domain 
A. (The point 20, however, may be an isolated singular point of these func- 
tions.) And as indicated in section 5.8 the extended functions ui{z) and a2{z) 
must satisfy the differential equation (6-1) everywhere within A. These are 
the solutions which we have set out to construct. We shall now show that 
they are linearly independent. To th;s^ end suppose that yi and 72 are any 
two constants such that 



yiUi(2)+y2U2(2)=0 



Substituting equations (6-8) and (6-~9) into this equation shows that 



[y,cV> + y2cf ] u;i(2)+ [yic<2^> + y242)] u;2(2) = 0 
And since w\ (z) and W2 (z) are linearly independent, it follows that 
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\ (6-15) 

Hence, upon multiplying equation (6-7a) by y\ and equation (6-7b) by 72 
and adding the results, we find that 

(Xi - X2)yicl»> = (\i - X2)y242) = 0 

But since we are considering the case where \i 7^ X29 this implies that 

And by using the facts that c\^^ and c|*^ are not both zero and c^p and cf^ are 
not both zero, we can conclude that yi = 72 = 0. But this shows that Ui{z) 
and u^iz) are linearly independent. 

Before discussing the implications of these solutions, we shall first treat 
the case where the roots of the characteristic equation are equal. 



6.2.2 Case 11: Rocts of Characteristic Equation Equal 

Thus, suppose that the roots of equation (6-6) are equal. Then the argument 
used in the preceding section can easily be adapted to show that there stili 
exists at least one solution to equation (6-1) of the form 

(2-2o)«'/,(2) (6-16) 

where fi{z) is a single-valued analytic function in A and 8i=(l/27ri) In Xi 
with Xi 7^ 0. We can therefore assume that the fundamental set <jf solutions 
tvi{z) and W2{z) of equation (6-1) in the domain Do (fig. 6-1) has been chosen 
in such a way that Wi{z) is given by equation (6-16)* By analytically con- 
tinuing this solution around F we find that in this case the function Wi{z) 
(defined in eqs. (6-3)) is given by l^i{z) — kiWi{z). And since Wi{z) and W2{z) 
are linearly independent, the first equation (6-4) shows that 
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ai2 = 0 

and 

au = \i 

However, these equations imply that the roots of the characteristic equation 
(6-6) are Xi = an 7^ 0 and \2 = a22. But since we are considering the case 
where \i = \2, it follows that au = a22 = A.i. Hence, in this case equations 
(6-4) become 



(6-17) 



W2{z) = a2llVi {z) + kiW2{z) 
We now define the function f2{z) on the domain Do by 



f2{z) = iz-zo)-^'W2iz)-^^^4^ In (2-20) (6-18) 

ZTTlAi 



This function can be analytically continued along any simple curve in A, and 
it will return to its original value when it is analytically continued along any 
closed curve which does not encircle zq. Its analytic continuation (counter- 
clockwise) along any curve F which encircles zo is 

f2{€^^Kz-zo) + zo) = (2-2o)-8'e-2'''8'r2 (z) - In e^^*{z-zo) 

Z.TTlK\ 

_ [z—Zq)-^' a2lfl{z) , , \ "21 ^ / s 

But inserting equation (6-16) and the second equation (6-17) into this relation 
shows that 
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Hence, the function /a (2) will return to Us original valu^ when it is analytically 
continued around any closed curve in A. It can therefore be extended to a 
single-vcJued analytic function on the entire domain (which may have an 
isolated singular point at 20). And we can now conclude from equations (6-16) 
and (6-18) that the extension of the solution 11^2(2) from Z?o to the entire domain 
A (which we shall also denote hy Wz{z) ) is a function of the form 

W2{z)^ {z-zoY'fiiz) ^awx{z) In (2-20) (6-19) 



where fz^z) is a single-valued analytic fuitiction on the entire domain A and we 
have put a == a2il2m\u It can again be shown that the solutions wi{z) and 
tV2{z) are linearly independent. 



6.2.3 General Conclusions 

Notice that the fundamental set of solutions (6-16) and (6-19) with a = 0 
are of the same form as the fundamental set (6-14) vAlh 8% = 82. The funda- 
mental set (6-2) which occurs at an ordinary point of equation (6-1) is a special 
case of the fundamental set (6-16) and (6-19). We have therefore established 
the following conclusion: Let zo be an ordinary point or an isolated singular 
point of equation (6-i ) and let R be the distance between 20 and the singu* 
lar point of equation {6-1 ) which is closest to 20. Then equation (6-i ) possesses 
a fundamental set of solutions on the punctured circular regiop^ 0 < |z — zoj < /? 
which is of the form 



wi{z)= {z-zo)^fi{z) 
W2{z) = (2 — Zo)^%{z) + awi{z) In {z — zo) ^ 



(6-20) 



where f\{z) and f2{z) are analytic single-valued functions in 0 < \z'-'Zo\< R 
and a, 81, and 82 are complex constants. 

The fundamental set (6-20) is called a canonical basis. The constant a 
is equal to zero whenever 81 — 82 7*^ 0, ±1, ±2, . . The case where 81 — 82 
== 0, ± 1, ±2, . . . is referred to as the exceptional case. Notice that the 
constant a may also vanish in the exceptional case. This occurs, for example, 
when Zo is an ordinary point of equation (6-1). 
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We should not conclude from these results, however, that the .solutions 
of equation (6-1) will always have singularities at the singular points of this 
equation. For example, the equation 

zW -2zw' + 2w=-0 

has an isolated singular point at z = 0. But the general solution to this equation 
is 

w — Aoz + Aiz^ 

where Ao and Ax are arbitrary. And this shows that every solution of this 
equation is analytic at z= 0. 

By changing notation we can rewrite this solution in the form 



w—ao + ai{z—l)+ {ai ao) {z — l)^ 



where ao and ax can now be taken as arbitrary. This is evidently a canonical 
basis at the ordinary point 2=1. Since it is an entire function, it certainly 
exists and satisfies the equation within a circle whose radius is larger than 
the distance between 2=1 and the nearest singularity (namely, z=0) of the 
differential equation. 

If either of the functions fi{z) ^nd ^2(2) in equations (6-20) is not analytic 
at 2o, then 20 must be an isolated singular point of this function. Hence, /i (2) 
and f2{z) can always be expanded in the Laurent series 



n— — aa 

h{z)= 5 bf{z-z,)" 



(6-21) 



which converge for 0< I2 — 2o| < /?. An important special case occurs when 
the functions fi{z) and 72(2) either have poles or are analytic at 20. Then the 
series (6-21) contain at most a finite number of negative power's of 2 — 20 and 
can therefore be written in the form 



"Which may or may not conlam negative powers of (z— zo). 
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fi- 2 *|/K2-Zo)" fort = 1,2 

where n and rz are finite integers (they may be negative or zero). However, 
we can shift the index in the sums by putting A:=a+n and then summing on 
k. Thus, 

65/> U--zo)^-^^-(2-zo)-i 2 a(/)(z-2o)'^ for 1=1, 2 

where we have put a^^ = ^^h^t^ for f = 1, 2. 

Inserting these equations into equations (6-20) shows that in this case the 
canonical basis is of the form 



fc=0 



3C 

^^^2(2) = (2 — 20)^2 2 a^^^i^z — z^Y + awxiz) In (2 — zo) 



(6-22) 



where we have put pi = 5i — n and p2 = 82 — ^2- The series converge everywhere 
within the circle I2 — 2o| < R (including the point 20) and they, therefore, repre- 
sent analytic functions within this circle. The solutions w\ and xo% are said to 
be regular. It follows from the fact that ri and rz are integers that a vanishes 
whenever pi — p2 7^ 0, ± 1, ±2, . . . since it vanishes when 61 — 62 has this 
property. 

We have already seen that equation (6-1) will always possess two regular 
solutions (with pi = p2 = a = 0) at the point 20 whenever 20 is an ordinary point 
of this equation (i.e., if p{z) and q{z) are analytic at 20). We shall now deter- 
mine certain conditions which the coefficients of equation (6-1) must satisfy 
at an isolated singular point 20 if this equation is to possess two regular solutions 
about 20. 

Since Wi{z) and m;2(2) are linearly independent in 0< I2— 2o|</?, their 
Wronskian (see section 5.9.3) 



7riz}== 



tVi{z) Wiiz) 

w[{z) w'^iz) 



(6-23) 
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cannot vanish at any point z of this domain. On the other hand, putting 

oe 

gi = 2 a[/>(2 — zo)*^" for 1=1, 2 in equations (6-22) and substituting the 
result into equation (6-23) shows that 

^-(2) = (2 ^ 2o)^-^^»-'Ci(2) + a{z - 2o)^'-*G2(z) (6-24) 

where we have set Ci == {pi — p\)g\gi + (2 --20) {g\g2^ g'xgi) and C2 ^ g{. 
Since g\ and g^ are single-valued analytic functions in the entire circle 
I2 — 2o| < R (including 20), it is clear that G\ and G2 are also functions of this 
type. And since a = 0 whenever the exponents pi + pz 1 and 2pi — 1 in equa- 
tion (6-24) do not diflfer from one another by an integer, this equation can 
also be written as 

^(2) = (2-2o)^Co(2) 

where X is the smaller of the two numbers pi + p2 — 1 and 2pi — 1 and Gq(z) 
is a dingle-valued analytic function in the entire circle \z — 2o| < /?. Hence, 
Gq{z) can be represented by a power series 

Co(2) = |;/r„(2-5o)" 

whose radius of convergence is R. But it follows from the fact that W{z) is 
not equal to zero in 0 < I2 2o| < R that there must be a smallest integer, 
say m, such that /im 7^ 0. Hence, 

%r(2)= (2-2o)^+'«C(2) (6-25) 

where 

G{Z) = X ^fc.m(2 - 20)*^ = (2 - 2o)-'"Co(2) 

is also a single- valued analytic function in [2 — 2o| < R but not equal to zero 
at zo. And since ^(z) does not vanish at any point of the punctured region 
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0 < |z — 2o| < /?, we conclude from equation (6-25) that G(x) is not equal to 
zero anywhere within the circle |z — 2o| < /? (including the point 20). Hence, 
differentiating (6--25) shows that 

yr dz dz z-zo 

where 



G'iz) 
Giz) 



is a single-valued analytic function in |z — zo\ < R since its denominator does 
not vanish in this domain. But equation (5-26) shows that the coefficient 
p(z) of u;' in equation (6-1) is related to the Wronskian by 

Thus, if equation (6-1) possesses two regular solutions, its coefficient p(z) 
must be of the form 

piz)=-^^ + P(z) (6-26) 

Z Zo 

Similarly, it can be shown by substituting the firgt equation (6^22) and 
equ??.tion (6-26) into equation (6-1) that this equation will possess two regular 
solutions at zo only if the coefficient qiz) is of the form 

where a and )3 are constants and Qiz) is analytic ctt Zo. We have therefore 
shown that equation (6-1) can possess two regular solutions at the point zo 
only if its coefficient p(z) has, at most, a simple pole and its coefficient q{z) has 
at most a pole of order 2. We therefore say that a singular point zo of equation 
(6—1) is a regular singular point if 
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\1) Pi^) is either analytic at zq or has a simple pole at Zq 
(2) q{z) is either analytic at 20, has a simple pole at zo* or eisp has a pole 
of order 2 at 20. 

Notice, however, that we have not yet shown that equation (6-1) always 
possesSrCS two regular solutions at any regular sihgular point. 

An isolated singular point of equation (6-1) which is not a regular singular 
point is called an ir^'egiclar singular point. 

In order to tr^sat the point z=oo, we must, as in section 5.3, introduce the 
new independent variable ^=1/2 into equation (6-1). Thtm the point 2=« 
will be an ordinary point, a regular singular point, or an irregular singular point 
if the point {=0 is, respectively, an ordiriiary point, a regular singular point, or 
an irregular singular point of the transformed equation. But the change of 
variable I/2 transforms equation (6-1) into the equation 

^+P„(£)^+<?o(C)u;=0 (6-27) 

where 

PoiO ^|-^p(^) = 22-22p(2) (6-28) 

<?o(^)^^g(^)-zM^) (6-29) 

Thus 2= cjo an ordinary point of equation (6-1) if both PoiO ^"d QoiO 
are analytic at ^—0, which is equivalent to saying that 2z^z^piz) and z^q(z) 
are analjtic at z<^^» Similarly, the point 2=co is a regular singular point of 
equation (6-1) if PoiO ^^s, at most, a simple pole at 4=0 and QoiO ^^s, at 
most, a pole of order 2 at ^=0, which is equivalent to saying that 2z'-z^piz) 
has, at most, a simple pole at 2= » and z^qiz) has, at most, a pole of order 2 at 
2 = «?. If the point 2= » is an isolated singular point of equation (6-1) but is not 
a regular singular point, it is an irregular singular point. It is clear that the 
coefficients piz) and qir} themselves must certainly be analytic at 2 = » when- 
ever this point is a regular singular point. 

These definitions are best clarified by considering an example. Thus, the 
differential equation 

2Hz-l)w'' - iz+ \)w' -f 2u;=0 
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can be written as 



U+i) 



2(2-1) 



Hence, 



9U) = 



And the function p has a simple pole at 2= 1 and a pole of order 2 at the point 
2=0. The point 2=0 must, therefore, be an irregular singular point. The func- 
tion q has simple poles at 2 = 0 and z=l. Hence, the point 2=1 is a regular 
singular point. All other finite points are ordinary points. In order to consider 
the point at infinity we must consider the functions 2z-'Z^piz) and z^q{z) 
(instead of the coefficients p and g) which, in this case, become 



Hence, 2z—z^p has a simple pole and z'^q has a pole of order 2. And this shows 
that the point at 00 is a regular singular point. 

We shall now show by actually giving a procedure for finding the solutions 
that the differential equation (6-1) always possesses two regular solutions at a 
regular singular point. 

6 3 SGlUTiCN OF EQUATION ABOUT ORDINARY POINTS AND REGULAR 
SINGULAR POINTS 

Let 20 be either an ordinary point or a regular singular point of the differ- 
ential equation 



Since p has« at most, a simple pole and q has, at most, a pole of order 2 at 20, 
the Laurent series expansion for p about 20 contains, at most, one negative 
power of 2 — 2o and that for q contains, at most, two. Let Ri and R2 be the 



22-22p = 22+ 



2-1 



2+1 




w'*+p(z)w'+qiz)w = 0 



(6-30) 
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distances between zo and the nearest singular points of p{z) and 9(2), re- 
spectively, to Zo. Then Ri and Ro wiD be strictly positive and 

X 

Piz)^ 5; Pk{z-zoV^' for 0< |z-zo| </?! (6-31) 

X 

9U) = 2 ?^U^2o)^"- for 0 < |z-zo| < Rz , (6-32) 

The point zo will be an ordinary point of the dlTerential equation if, and only if, 

po=9o = 9i=^0 (6-33) 



6.3.1 . First Regular Solution 

We shall now show that equation (6—30) always has at least one solution 
of the form 

w{z) = (z - zo)^ § a„ (z - Zo) " (6-34) 

1=0 

in some punctured circular region about the point Zo. This will be accomplished 
by first showing that the constants p and an can always be determined 
in such a way that equation (6-34) formally satisfies the differential equation. 
It will then be shown, a posteriori, that the formal operations were indeed 
justified and therefore that the formal solution is, in fact, a true solution of 
the differential equation. The procedure which we develop by this process can 
then always be used to construct a solution to any given differential equationi 
of the form (6—30) in the neighborhood of any of its ordinary points or regular 
singular points. 

Since the assumed expansion (6-34) must certainly have a leading term 
and since the exponent p is not, as yet, specified, we can always assume 
that matters are arranged so that ao 9^ 0. We now substitute this expansion into 
the differential equation (6-30) and suppose that the series can be differen- 
tiated term by term. Then 
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^ (n + p)in + p-l)an{z-zo)"+^-^ 



n=0 



+ Piciz-zo)''-'] [5 {n + p)a„{z-zoy^'>-A 

[1; - zo)*-^] f I; a„(2 - 20)"+"] = 0 



+ 



And after forming the Cauchy products of the series and adding the resuUing 
series term by term, we get 

f^iz- zo)"+^-2 { (n + p) (n + p - l)a„ + y [ (A: + p)p„_^ + - 0 

(6-35) 

Now it follows from the uniqueness property of power series that this 
series will vanish for all values of z in some domain only if the coefficients 
of each power of z — zo vanish individually. Upon equating these coefficients to 
zero, we obtain for n=0 

F(p)ao=0 (6-36) 

and 

F(n + p)a„ = -2 ajc[{k + p)pn^k + qn-k] for /i = 1, 2, . . . 

(6-37) 

where we have put 

F(p) =p2+ (po-l)p + go (6-aB) 
Since, by hypothesis, oo 5^ 0, equation (6-36) implies 
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F(p) ^ p2 + (po - 1 )p + go == 0 (6-39) 

This quadratic equation is ciilled the indicial equation. Its two roots are 
called the characteristic exponents of the differential equation at the point 
2o. Equation (6~37) is called the recurrence relation. 

If the constant p in the assumed solution (6--34) is chosen to be a root of 
the indicial equation (6-38), the coefficient of (z — zo)^"^ in equation (6-35) 
will vanish for arbitrary values of the constant oo. And if there is no positive 
integer n for which F(n + p)=0, equation (6-37) can be used to calculate 
successively (starting with ao) the coefficients^^ an in such a way that the 
coefficients of all the remaining powers of z -~ zo in equation (6-35) will vanish. 
Thus, when the constants p and an for n = 1, 2, . . . are determined in this 
manner, the series (6-34) will at least formally satisfy the differential equation 
(6-30) with the constant ao arbitrary. 

Of course, if F{n + p) vanishes for some positive integer n, we have no 
assurance that equation (6-37) can be used to calculate an. But let the roots of 
the indicial equation (i.e., the characteristic exponents) be denoted by pi 
and pi with the notation chosen so that ^ p\^ ^ p^, and let 

P = pi— P2 (6-40) 



Then 

^ (6-41) 

And since a quadratic function can always be expressed as the product of its 
factors, we can write 

F{p) = {p-px){p-p2) 

Hence, 

F{n + px) = n{n+p) (6-42) 



Notice that for each integer n the recurrence relation (6-37) expresses Oh only in terms of the coefficients 
Ok with 0 ^ ^ < Hence, it can be used to first determine at in terms of oq and then to determiiie in tet ms of at 
and oq. But since Oi is known in terms of flo, this determines 02 in terms of ao. By proceeding in this manner, each On 
can be determined in succession in terms of ao. 
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Then, since equation (6-41) shows that 



{n+v)=n + .^v^n (6-43) 
it follows from equation (6-42) that 

F(n + pi)7^0 forn==l,2, . . . (6-44) 

Hence, when p^'Pi, the coefficients an forn= 1, 2, . . . can all be calculated 
recursively in terms of ao from the recurrence relation (6-37). Thus, equatioL: 
(6-30) will always possess at least one formal solution of the form (6-34) about 
the point 2o. 

It is still necessary to verify that this formal solution is justified. In order to 

00 

do this, we must show that the series ^ Uniz — zo)^ obtained by the procedure 

described actually converges. We can then conclude from the theory of power 
series given in section 5.5 that the formal operations of (1) differentiating the 
series (6-34) term by term, (2) forming the Cauchy product of the resulting 
convergent series with the convergent series (6-31) and (6-32), and (3) adding 
the resulting convergent series term by term are justified and, hence, that 
equation (6-34) is indeed a solution to the differential equation (6-30). 

In order to establish the convergence of the series in equation (6-34) for 
the case where p = Pi, notice that in view of equations (6-42) and (6-44) the 
recurrence relation (6-37), with p = pi, can be put in the form 



n-l 



an — — — } — \ — for n= 1,2,... (6-45) 



We shall subsequently encounter (in ch. 9) a case v^^re the constructed series a<^tua!Iy diverges and hence 
the formal priced «r;:o ^i- :'.c::::ur: 

VI 
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Therefore, 



an = 



n-l 



\n{n+u) I 

S I l[ IPn-A- I I Pi 1+ I qn-k\ + k I pn-k | ] 



n\ n+u\ 



(6-46) 



Let /?=min ^2}, where Ri and i?2 are the radii of convergence of 
the series (6-31) and (6-32) for p anc q, respectively. Then R is strictly positive 
(since Ri and R2 are positive) and the Cauchy estimates, ^van in section 5.5, 
for the derivatives of the analytic functions p and q imply that there exist finite 
positive constants M and such that 



\Pk\^^. and 



qk\^-^ forA = 0,l,2, 



(6-47) 



which implies that 



Pk\\pi\ + \ Qk 



Hk 



for yt ^ 1 



And since |n+ i^j ^ ^ (n+ 1^), it follows from equation (6-43) that |n+ i^l ^ n 
for n=l, 2, . . .. Inserting these results into equation (6-46) shows that 

-^—)r^- forn=l,2,... (6-48) 

Now put P = M\px I + A^4- M+ 1. Then P is a finite number which is larger 
than 1; and for n ^ 1 and k < 
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M\pi\ + N+kM ^ M\pi\+N~hM 



n n 



Hence, it follows from equation (6-48) that 



for n= 1,2 



> • • • 



(6-49) 



which forn= 1 becomes 



(6-50) 



Suppose that forn > 1 




<n 



(6-51) 



We shall now show that this implies that the inequality also holds when 
k ^ n. Since n can be any integer larger than 1 and since equation (6-50) 
shows that the inequality also holds when n=l, we can then conclude by 
induction that the inequality will hold for every positive integer n. Thus, 
inserting the inequality (6-51) into equation (6-49) shows that 



But since P^l, it follows that P''^P»-i. And when this is inserted into 
equation (6-52), we find that 



Hence, we can conclude by induction that this inequality holds for every 
positive integer n. 

We can now use this inequality to show that the series V an{z—zoY, 




(6-52) 




(6-53) 
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which appears in the solution (6-34), converges at least within the circular 
region (of nonzero radius) 

To this end, notice that within this circle the inequality (6-53) shows that the 
nth term of this series has the property that 

|an(z-zo)1 = \an\ |z-zo|" ^ |ao| = |ao| ^ (6-55) 

And since the series 

M 1 

is simply a geometric series, it certainly converges. Hence, in view of the in- 
equality (6-55), a simple application of the comparison test shows that the 

ao 

series V ctniz^zo)^ is absolutely and uniformly convergent at least within 

the circle (6—54). It, therefore, represents an (single valued) analytic function 
within this circle. 

Thus, we have shown that 



wtiz) = iz- zoy^ X d^Kz - zo)^ (6-56) 

is a solution to equation (6-30) within some circle about zo for arbitrary 
provided the coefficients d^^ for n == 1, 2, . . . are computed from the recurrence 
relation (6-45). But the series in (6-56) converges within a circle about zo 
which passes through the singular point of Wi (aiknearest to zo* In fact, the radius 
of convergence of this series must be at least as mge as the distance /i between 
Zo and the nearest singular point of equation (^30). In order to prove this,^ 
notice that Ri and /?2, the radii of convergence of the series for p and ^, re- 
spectively, must be equal to the distance between zo and the nearest singular 



MSee ref. 23. 
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points of these functions. But it follows from the definition of a slngiUar point 
of a differential equation that R == min R2}' Hence, p and q are single 
valued and analytic within the punctured circular ;^^gion A defined by 
0 < \z — zo\ < R' Now since Wi is a solution to the differential equation, it 
must be possible (as shown in section 5.9.2) to analytically continue this 
function along any simple curve in A. And, therefore, ivi cannot have any 
singular points within A, But it certainly has a singular point on its circle of 
convergence. Hence, its radius of convergence cannot be smaller than R. 
And this proves the assertion. 

Since the analytic continuation of a solution of the differential equation 
(6-30) is also a solution of this equation, we can now conclude that the function 
ivi{z) given by equation (6-56) converges and satisfies the differential equation 
{6-30) at every point of the domain 0 < I2 — zo| < /?, where R is the distance 
between zo and the nearest singular point of equation (6-30). 

We have now shown that equation (6-30) possesses a regular solution 
(6-56) about any ordinary point or regular singular point of this equation. 

Before obtaining a second regular solution we shall introduce an example 
to illustrate the procedure described in the preceding paragraphs. Thus, 
consider the equation 

Sz^w" + zw' - {l + z)w=0 (6-57) 
Since the coefficients p and q are 

and since the coefficients (6-28) and (6-29) of the transformed equation are 
2z-z^p-j z*q^ 3 

we see that every point is an ordinary point except the point z = 0, which is a 
regular singular p^>int, and the point z= oo^ which is an irregular singular point. 

We know that if we seek a solution about the regular singular point 
z = 0 of the form 
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X 



(6-58) 



we will obtain at least one and perhaps two solutions to the differential equation 
in which the constant ao is arbitrary. And since the nearest singular point of 
the equation to z = 0 is at oo, we know that the series will converge in the 
entire plane. 

Instead of using the general formulas obtained above it is usually easier 
in any given case to derive the solution from first principles by substituting 
the assumed power series into the differential equation. Thus, after substituting 
equation (6-58) into equation (6-57) and differentiating term by term, we get 



In order to collect the coefficients of like powers of z, it is convenient to 
reindex the sums so that the same powers of z appear in each term. Thus, in 
the second sum, we replace the dummy index n by the index A: ~ /i+ 1 and in 
the iirst sum we put n = k. And since k = l when n = 0, in the second sum we 
obtain 





£ [3(/i + p)2 - 2(rc + p) - l]a„z«+^ - ^ anZ«+^+i = 0 




2 [3(^+p)2~2(A: + p)-l]afcZ^+p-2 a^^iz'^+p = 0 



Now equating to zero the coefficients of like powers of z gives 



[3p2-~2p-~l]ao = 0 foTk = 0 



and 



[^k + p)^-2{k + p)^l]au = aJc^^ 



for ^=1,2 



(6-59) 



Since ao 7^ 0, the indicial equation is 
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And its roots are 

p, = l and P2=l/3 (6-60) 

When p = l, the recurrence relation (6-59) can be solved for all values of A: 
and can be written as 



CLlc—i 

^'^^A(3/:+4) for A- 1,2, 



or writing out the first few terms 



ao 



02 = 



2X10 



/I (3/1 + 4) 

In order to determine a„ in terms of oo we multiply together both members of 
these equations to obtain 



1 

^••"^ • • • ""==(1-2 . . . n) [7-10 . . . (3« + 4)]^*"' ' ' ' 



and then divide through by ai • a2 . . . Un-i to get 

Qn= .p-T in . /tM for /i = 1, 2, . . . (6-61) 

n![7 • 10 . . . (3n + 4)J 

Notice that the term in square brackets is a product whose factors are 
elements of an arithmetic progression. The factors in this progression in- 
crease by 3 in each term. Hence, if we factor out a 3 from each term we obtain 
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7 . 10 • 13 . . . (3„ + 4) =3" (|)(|+ l) (1 + 2) . . . (|+„- l) = 3" (|)^ 

where we have the generalized factorial function defined in equation (5-33). 
Upon substituting this into equation (6-61) and then substituting the result 
together with p = 1 into equation (6-58), we obtain the regular solution 



where we have put Ao = 




(6-62) 



6.3.2 Second Regular Solution 

We shall now use the regular solution Wi{z) obtained in section 6.3.1 to show 
that equation (6-30) always possesses a second regular solution about any 
ordinary point or regular singular point zo. In order to do this we use the results 
obtained in section 5.9.3, which show that 



W2{z) = wtiz) J ^ ^;^(^)] 2^ 'J (6-63) 

is a solution of equation (6-30) which is linearly independent of u;i(z). We have 
omitted the arbitrary constant c in equation (5-28) since we may assume that 
it has been absorbed into the arbitrary constant oo which multiplies Wi{z). 

Now upon integrating equation (6-31) along any path in the punctured 
circular region 0 < \z — zo\ < Ru we obtain 

j piz)dz = poln{z — zo)+co + go{z) (6-64). 

where 

Pk 

^o(2)^gy U-2o)* (6-65) 
and Co is an arbitrary constant. 
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Since the series ^ Pkiz'^zo)^' converges, the series (6-65) must also con- 

verge (section 5.6). Hence, go{z) is m analytic function in a circle centered at 
zo. It, therefore, follows from equation (6-56) that 



[wi {z)y 

= {z-zo)'^^^^^^^g{z) (6^6) 

where we have put 

giz) = and gi{z) ^ V o^^^z-zo)" 

[giiz)y {^0 

Since ai}^ # 0, there is some neighborhood of the point zo in which gi{z) 
is never equal to zero And since gi (z) is analytic at zo, it follows that the func- 
tion [gi{z)y^ is also analytic and not equal to zero^^ at zo. Similarly, it follows 
from the fact that go{z) is analytic at zo that exp [— go(z)] is analytic and non- 
zero^* at Zo. Hence, the function g{z) is analytic and not equal to zero at 
Zo. It can, therefore, be expanded in the power series 

X 

giz) = y an(z-zo)" with ao9^0 (6-^7) 

n=0 

which converges m a circle of finite radius about zo. 

Now since the two roots pi and p2 of the quadratic indicial equation (6-39) 
are given by 

'-(po-l)±V(po- 1)^-4(70 
2 

it follows that pi + p2 = l"^Po. And therefore, in view of definition (6-40), 

2pi + po=i^+l (6-68) 



Notice that [(?i(z)]-2 and exp [—go{z)] can only equal zero at points where ^i(z) and ^0(2), respectively, 
become infinite; i.e., at aingula^ points of these functions. 
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When equations (6--67) and (6-68) are substituted in equation (6-^) 
and the resulting expression is substituted into the integrand of equation 
(6-63), H e find that 

f 1 * 

And it follows from the fact that the power series converges that we can 
interchange the order of summation and integration (section 5.6) to obtain 



u;i(z) V— f-(z-zo)"- for 1^^0,1,2, . . . 

(6-69) 

^tiz) Y—;—-{z — zoy-'^+Wi {z)ai, In {z — zo) for 1^ = 0,1,2, . . . 



n=0 



Since these series converge, they represent analytic functions within 
their circle of convergence. Therefore, the product of either of these series 
with the series in equation (6-56) is again an analytic function which can be 

X 

expanded in a power series ^ a^^^ {z — zo)" with a nonzero radius of converg- 

n = o 

ence. Hence, in view of definition (6-40), it follows from equation (6-56) that 
equation (6-69) can be put in the form 

u;2(z)= (z-Zo)^» V a^Kz-zoy + awi{z) In (z-zo) (6-70) 

where a = 0 for 7^0, 1,2, . . . 

By repeating the argument used in section 6.3.1 to determine the size of 
the circle of convergence of the solution (6-56), we can again show that 
the function iV2{z) given by equation {6-70) converges and satisfies the differ- 
ential equation {6-30) at every point of the domain 0 < |z— zo| < /?, where R 
is the distance between Zo and the nearest singular point of equation {6-30). 

We have now proved that the linear second-order differential equation 
{6-30) possesses two linearly independent regular solutions at every ordinary 
point and at every regular singular point. 

In order to shov/ how to construct the solution (6-70), it is necessary 
to consider certain cases separately. 
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6.3.2.1 Case (i): pti^O^ 1^ 2^ . . .—First, consider the case where the 
difference in the characteristic exponents is not equal lo an integer. Then 
a = 0 in equation (6-70), and this solution is of the same form as the trial 
solution (6-34) with p = p2. Hence, if equation (6--70) is substituted into the 
differemial equaiion (6-30), we will find, as before (since p2 already satisfies 
the indicial equation), that the coefficient a^^) must satisfy the recurrence rela- . 
tion (6-37) with p = p2. But since equation (6-40) and the equation following 
equation (6-41) show that F{n + p^)^n{n — p)^ the recurrence relation (6-37) 
with p=p2 can be written in the form 



And since p is not equal to an integer, the coefficient of Cn never vanishes. 
Hence, this equation can be solved recursively to determine the coefficients 
a^^ in exactly the same way that the coefficients a^^ in the first solution (6-56) 
were determined. Nothing new is involved. In fact, in solving the recurrence 
relation in this case it is usuedly easier to leave p unspecified as long as possible 
and to determine the coefficients of the first and second solutions 
simultaneously. 

For example, the left member of the recurrence relation (6-59) of the 
differential equation (6-57) considered in section 6.3.1 can be factored to 
obtain 



n-i 





(6-71) 



for/r=l,2 



ip + k-l) (3p + 3A+l) 



or, writing out the first few terms. 
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Co 

p(3p + 4) 

Qi 

(p+1) (3p + 7) 



(p + n-1) (3p + 3n+l) 
And upon multiplying together both members of these equations we obtain 
ai • a2 • ^3 • . . dft 

Op * Oi * 02 , , , an-x 

""[pCp+l) . . . fp + n-1)] [(3p + 4) (3p+7) . . . (3p+3n+l)] 

Hence, 

^ Co 

^" [p(p+l) . . . + [(3p + 4) (3p + 7) . . . (3p + 3n + l)] 

The characteristic exponents pi and p2 are given by equation (6-60). If ve 
set p = pi — 1 in this equation, we obtain the coefficients of the first solution. 
But if we set p = p2» we obtain the coefficients 
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(to 

TiT)-(f)-(i)---m]t— 

ao 

[(-1) •2-5 .. . (3/i-4)]n! 

of the second solution. After using the generalized factorial function (eq. 
(5-27)) to get 

(-1).2.5. . .(3n--4)=3"(-|)(-|+l)(-i-+2). . .(-l+n-l) 

and then substituting the results with p=l/3 into equation (6-58), we find 
that the second solution to equation (6-57) is 



X 




where we have put fio = 6o3~*'^- 

6.3.2.2 Case (ii): v= U 2, . . . and a = 0. — In this case the second 
solution (6-70) will also be of the same form as the trial solution (6-34) 
with p = p2. Hence, its coefficients a{f^ for n=l, 2, . . . must again be deter- 
mined by the recurrence relation (6-71) with p = p2* But since v is a positive 
integer, the left-hand side of this equation will vanish when n= v. The recur- 
rence relation for a^ can therefore not be satisfied unless the right-hand side 
of this equation 

^ aic[{k + p2) Pi;^k+ Qu-k] 

k=o 

also vanishes, in which case it will be satisfied automatically for all values 
of a„. We then obtain a solution involving two arbitrary constants. And since 
this solution must be a general solution to the differential equation, it will 
contain the solution obtained for p=pi. 
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This situaiion will always occur in the important special case when zo 
is an ordinary point of the differential equation. For in this case, equations 
(6-33) and (6-39). show that the indicial equation is 

Fip)^p{p-l) = 0 

Hence, the characteristic exponents are pi = 1 and p*z=0; and their difference 
I' = pi — p2= 1 is a positive integer. But it follows from equation (6-33) 
that the recurrence relation (6-71) for ai becomes 

lX0Xai = ao[(OXp,) + 0] 

and this is automatically satisfied for any choice of Oi. The recurrence relation 
(6-71) with n = 2, 3, . . . will then uniquely determine the remaining On. 
We therefore obtain in this case a solution which involves two arbitrary 
constants. 

For example, consider the equation 

(z2 - 1 ) m;" + 6zw' + 4m; = 0 (6-72) 
Since its coefficients p and q are 

we see that the only singular points of this equation are regular singular points 
at 2 = 1, 2 = — 1, and 2 = 00. 

We know that if we seek a solution about the ordinary point 2 = 0 of the 

form 

w=^ anz^ (6-73) 

n=0 

we will obtain a general solution to the differential equation in which the 
coefficients ao and ai are arbitrary constants. And the series will converge at 
least within the circle \z\ < 1. 



«2 That u must be an integer in this case could easily be anticipated from the fact that the characteristic exponents 
themselves must be integers if the solutions are to be analytic at 2 — 20* 
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Thus, after substituting the expansion (6-73) into equation (6-72), differ- 
entiating term by term, collecting terms, and factoring the coefficient of z", 
we obtain 

-J n(/i~l)a„z"-2+ J (/i + 4)(n+l)a;,z"=0 

n-O n=0 

which becomes, upon shifting the index in the second sum, 

A(A-l)a/cZ^-2 + ^ (A+2)(A-l)a/fc-22*-2 = o 

We now equate to zero the coefficients of like powers of z to get 
OX(-l)ao=0 lxOXai = 0 

and 

-^(A~l)aA+(A + 2)(A-l)a/c-2=-0 forA = 2,3, . . . 

The first two equations merely serve to show that oo and ax are arbitrary, as 
we already know. And since the coefficient of au is not zero for A: ^ 2, we can 
write the remaining equations as 

au = -^^au-.2 forA = 2,3, . . . (6-74) 
k 

This equation shows that each succeeding au. is determined from the o/ 
whose subscript is 2 lower than its own. Thus, this recurrence relation will 
ultimately determine the a/t with even values of A: in terms of ao and the with 
odd values of A: in terms of ai. It is, therefore, convenient to consider separately 
the equations for even and odd values of k. First, upon writing out these 
equations for even values of A: beginning with a2, we find that 
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4 

Cl2 — ~n (iO 



aA ^02 



_ 20+1) 
2/ ■^"'^ 

Similarly, for odd values of A: beginning with as, we find that 



a3 = — 



3 a, 



05 = 



-3 as 



2j + 3 
azj+i 2j+\ "^■'"^ 

Multiplying together both sides of the equations for even values of A: and 
dividing through by a2 • a4 • ae • • . a2j-2 gives 

_ [4-6-8 . ■ . 2(7+1)] 
~ 2-4-6 ... 27 

which becomes, upon removing the common factors of the numerator and 
denominator, 



ERIC 



DIFFERENTIAL EQUATIONS 



«2j=(y+l)ao for ;= 1,2, . . . (6-75) 
And upon proceeding the same way for the odd values of A:, we obtain 

Q2j+i= g ai for ;= 1,2, . . . (6-76) 

Since equations (6-75) and (6-76) show that the coefficients of even and 
odd powers of z are given by different expressions, it is convenient to first re- 
arrange the series (6-73) into two series, one containing the even powers of z 
and the others containing the odd powers. This is legitimate since every 
rearrangement of a convergent powers series converges to the same sum. Thus, 
equation (6-73) becomes 

And upon substituting equations (6-75) and (6-76) into this expression, we 
obtain the general solution 

j=0 j=l^ ^ 

to equation (6-72). It is easy to see that both series converge in the circle 
I 2 I < 1 and diverge outside this circle. 

In both the examples given thus far in this section, explicit expressions 
for the general terms in the series were obtained. Also the recurrence relations 
in both examples (see eqs. (6-59) and (6-74)) involved only two different 
coefficients; whereas, in general, the recurrence relation will involves different 
coefficients (see eq. (6-37)). It is, in fact, true in general that there is little hope 
of obtaining an explicit expression for the solution unless a two-term recurrence 
relation is obtained. This is not necessarily a limitation on the method because 
any recurrence relation can be used to successively calculate numeiically as 
many terms of the series as desired. In fact, it is in the cases where many- 
term recurrence relations occur that the general convergence theorems are 
particularly useful since, without having an explicit expression for the general 
term, it is not possible to tell from an infinite series itself whether or not it is 
convergent. 



194 



SECOND-ORDER EQUATIONS IN THE COMPLEX PLANE 

6.3.2.3 Case (Hi): p=0, 1,2,... and Et^O. — In this case the loga- 
rithmic term will be present. Notice that in case (ii) we did not include v=0. 
The reason for this is that when p=0 the characteristic exponents are equal 
and therefore there is only a single recurrence relation. Hence, there can only 
be one regular solution of the type (6-34) and the logarithmic term must be 
present in the regular solution (6-70). When v = 1,2, .... a will not be equal 
to zero if, and only if, the recurrence relation (6~71) cannot be solved for a^. In 
this case, no generality will be lost if we set ^ a — \ The solution can always be 
determined by substituting equation (6-70) into the differential equation, using 
the fact that m;i is a solution to simplify the result, and then setting to zero the 
coefficients of the various powers ^ of z — zo to calculate the coefficients 
aj,2) recursively. 

The procedure is best illustrated by considering an example. Thus, th3 
differential equation 

zw" -zw' -w = 0 (6-77) 

has a regular singular point at z = 0 and an irregular singular point at z= <». 
We know that this equation will possess at least one solution of the form 

u;=2)a„z"+^ (6-78) 

about the point z = 0 and that this solution will converge in the entire complex 
plane. Upon substituting the expansion (6-78) into equation (6-77), inter- 
changing the order of summation and differeraiation, shifting the indices, and 
collecting terms, we obtain 

y{n + p){n + p- l)a„z»+p-i + p)an-i2"+^~' = 0 

Equating the coefficients of like powers of z to zero gives for n = 0, since ao 
is arbitrary, 

p(p -1)=0 (6-79) 



^ Since tvi is detemined only to within a constant factor, 
^ The logarithmic terms will always cancel out. 
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and 

{n + p — l)an = an^i for re =1,2,... (6-80) 

The roots of the indicial equation are Pi = 1 and p2 = 0; hence, the difference 
of the roots p = pi — P2 = I is an integer. First, consider the case where 
p = Pi = 1. The recurrence relation is (see eq. (6-76)) 

an = ^ an-i forn = 1, 2, . . . (6-81) 

After writing out the various terms of equation (6-81), multiplying the cor- 
responding members of these terms together, and dividing out common factors, 
we get 

1 1 

1 • 2 • 3 . . . n nl 

Hence, we find that the solution for p = 1 is 

= ^ S 7i (6-82) 

which can easily be summed to obtain 

Wi = aoze^ (6-83) 

Next, consider the case where p = p2 = 0. The recurrence relation is 
(n — l)a„ = a,i-i. Since ao 0, it is clear that this equation cannot be solved 
for ai. Hence, the differential equation must possess a logarithmic solution. 
We, therefore, seek a second solution of the form 

00 

anz'' + tvi{z) In z (6-84) 

Upon substituting this expansion into equation (6-77) and recalling that tvi 
satisfies the differential equation, we find that the resulting coefficient of In z. 
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vanishes. Then shifting the index and collecting terms in the summation gives 

( 2u;|-iu;,-u;, ) + J [n(n-l)a„-na„-,]z«-» = 0 (6-85) 
Hence, after substituting in equation (6-83), we get 

ao(l + z)e^+ J [n{n-l)an-nan-i]z''-^^0 (6-86) 



But replacing by its series representation ^ and then shifting the 
indices shows that 



Then upon equating to zero the coefficients of like powers of z, we find that 

ao'^-do for n — 1 

and 



°."ffft- („_i)7„-i), forn=2,3,4, ... (6-87) 

where ao and a\ are arbitrary. Actually, we could simplify matters by setting 
ai = 0, but we shall carry ai through as an arbitrary constant in order to 
demonstrate this. 

Upon writing out the first few terms of equation (6-^7), we get 



a2 = -T — 



1 1-1! 



a2 0.0 



«3 = -7r — 



2 2-2! 



1-2 2!A 2/ 
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a4 = 



3 3-3! 
Hence, we conclude by induction that 



1 • 2 • 3 3! V 2 3/ 



a„ 



ai 



ao 



Hn-i torn = 2, 3, 



(6-88) 



(n-1)! {n-l)\ 
^^here we have defined //« to be the partial sum of the harmonic series. That is, 



0 for n = 0 



11 1 " 1 



(6-89) 



for n = 1, 2, 



Substituting equations (6--83) and (6-88) into equation (6-84) yields 



W2 = ao 



which becomes, after shifting the indices in the sums, 



W2 = ao 



ize' In z) + 1 - f HnZ^^A + ai 2 ^ 



Notice that the second sum is essentially the solution Wi. Hence, the term in 
square brackets must be a solution which is linearly independent of Wu This 
(i.e., the bracketed term) is the solution we would have obtained if we put ai = 0. 

6.3.3 Summary 

We have now shown how two linearly independent solutions to the differ- 
ential equation (6-30) with analytic coefficients can be found in the neighbor- 
hood of any regular singular point zo. First the indicial equation (6-39) is 
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determined. If the difference v of the two roots of this equation is not an 
integer (including zero), two solutions of the form (6-34) are obtained, one 
for each root of the indicial equation. However, if is an integer, the recurrence 
relation (6-37) for the term must be investigated with p = p2. It will either 
automatically be satisfied for any a^, or it will be impossible to satisfy for any 
a^. If it is automatically satisfied, ao and will be arbitrary; and we will 
obtain two linearly independent solutions with p = P2. If v=0 (i.e., pi = P2) 
or if 7/ is an integer and it is impossible to satisfy the recurrence relation, the 
solution will have the form (6-70) and can be found by substituting this form 
into the differential equation. The point at infinity is treated by making the 
change in variable z= 1/^. 



6.3.4 Computation of Indicial Equation 

Since the nature of the solutions of equation (6-30) in the neighborhood 
of a regular singular point zo is so dependent on the roots of the indicial equa- 
tion (characteristic exponents), it is useful to be able to determine this equa- 
tion without first finding the expansions (6-31) and (6-32) of the coefficients 
about Zo. 

Equation (6-39) shows that this is accomplished once po and qo are known. 
But it follows from equations (6-31) and (6-32) that 

{z-Zo)p{z)^Po+ ^ Pk{z-zo)^ 



{z-Zo)^q{z)==qo+ ^ qk{z—zo)^ 

k=l 

Hence, 

po = lim [(2 — zo)p(z)] and 9o=lim [{z-'Zo)^q{z)] 

Thus, for example, the equation z^w''+z{2 + Sz)w' + {l'-z)w=0 has a regular 
singular point at z = 0 and 



(\ 2 ~\~ 3z J /viz 

z) = and 9U) = — 2- 
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Hence, 

po= lim z — ^) = 2 and 90= lim {r~r\ 1 

z-*0 \ I z^O \ Z^ / 

and the indicial equation (6-39) is 

(po-l)p+go=p*^ + p+l = 0 

If the regular singular point zo is the point at infinity, we make the change 
variable^ z = 1/^ and investigate the point ^ = 0. This leads to the relations 

And upon changing back to the orit^nal variable z, they become 
po = lim [2 — zp (z) ] and qo — lim z^q (z) 

2— *00 2~~*C0 
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Riemann-Papperitz Epation and the 
Hyper^eometric Epation 

7.1 THE FUCHSIAN EQUATION 

Having shown how to construct solutions to a differential equation with 
analytic coefficients about its regular singular points, it is natural to study 
those equations whose only singularities (in the extended plane) are regular 
singular points. Such equations are called Fuchsian equations. We shall restrict 
our attention to Fuchsian equations of the second order; that is, equations of 
the form 

w'' + p{z)w' + q{z)w=^0 (7-1) 

This equation can have, at most, a finite number of singular points. In order to 
prove this, notice that since the only singularities of the coefficients p and q in 
the extended plane are poles, these functions must be rational (see section 
5.4). But since the number of singularities of a rational function which occur 
at finite points of the plane is equal to the number of distinct zeros of its poly- 
nomial denominator, it follows that p and q have, at most, a finite number of 
singular points. However, every second-order equation must have at least one 
singular point. For if equation (7-1) had no singularities in the extended plane, 
the coefficients p and q would be everywhere analytic; and, hence, by Liou- 
vilie's theorem, they would be constants. However, even if the constant value of 
p were zero, the coefficient 2z — z^p{z) of the transformed equation (see 
eq. (6-28) ) would still have a simple pole at infinity. But this would contradict 
the assumption that equation (7-1) had no singularities. Hence, we conclude 
that thiis equation must have at least one singularity. 
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Since the rational function p has, at most, simple poles and the rational 
function q has, at most, poles of order 2, it is clear that any Fuchsian equation 
with not more than m singular points in the finite plane must have coefficients 
of the form 



q{z) 



(2 — — 22) . . . (Z — Zm) 

Q{z) 



(Z — Zi)2(z — Z2)2 . . . (Z — Zm)^ 

where P and Q are polynomials. 

7.1.1 Fuchsian Equations With, at Most, Two Singular Points 

There are two possible forms which a Fuchsian equation with, at most, 
two singular points can have. First, consider the equation which has, at most, 
one singular point in the finite plane (with a possible singular point at infinity). 
Its coefficients must take the form 

/ X P{Z) , , Q{Z) 

But if the coefficients of the transformed equation 2z— z^p and z'^q are to have 
at most a simple pole and, at most, a pole of the order of 2, at infinity the 
polynomials P and Q must both be constants, say ^ andfi, respectively. Hence, 
the differential equation must be of the form 

A B 

w" + w' + -. z^^=0 (7-2) 

z — a (z — a)2 ^ ^ 

Next, consider the case where the singular points are both in the finite 
plane. Then the coefficients must be of the form 

^ iz-a){z-b) ^ (2-a)2(z-6)2 

But the coefficients 2z — z^p and 2^9 of the transformed equation will be analytic 
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at 2 = 00 only if there are constants C and D such that P = 2z+C and Q = D. 
Hence, in this case the differential equation must be of the form 



u;" + 



22 + C 



m;' + 



D 



(z-a){z-b) {z-a)Hz-by 



w = 0 



(7-3) 



Thus, a Fuchsian equation which has, at most, two singular points must be 
either of the form (7-2) or of the form (7-3). It is easy to verify that the 
general solution of equation (7-2) is 



w = 



Ci (z - ay I + C2 (z - a)^2 if {A - 1)^-48 # 0 
^(z-a)^i[Ci + C2 In(z-a)] if (^-l)^- 4B = 0 



where Ci and C2 are arbitrary constants and pi and P2 are the roots of the 
indicial equation p*^+ (A — l)p + B = 0. Since the change in independent 
variable f=l/(z — 6) transforms equation (7—3) into an equation of the form 
(7-2), it follows that the general solution to equation (7-3) can also be ex- 
pressed in terms of elementary functions. 

Thus, the solutions of any Fuchsian equation which has no more than 
two singular points in the extended plane are elementary functions. 

7.1.2 Fuchsian Equations With, at Most, Three Singular Points 

In order to obtain a Fuchsian equation whose solution is not elementary, 
we must consider an equation which can have three regular singular points. 
If we require first that these three points, say a, 6, and c, all lie in the finite 
plane, the coefficients of the differential equation must have the form 



( X _ P(z) . . ^ Qjz) 

P^'^ {z-a){z-b){z--c) ^^^^ {z^a)Hz-bnz-cr 

where P and Q are polynomials. And since the point z= 00 is to be an ordinary 
point, the coefficients of the transformed equation 



„ z'P . ^ 

{z-a){z-b){z-c) ^""^ iz-a)Hz-bnz-cr 
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must be analytic at z = oo. But this can occur only if P and Q are quadratic in 
z and the coefficient of in P is 2. Since the degree of the numerator is less 
than the degree of the denominator, it follows from the elementary theory 
of partial fractions that there exist constants Aa^A^^ Acj Ba^ Bb^ and Be such that 

P{z) ^ Ag ^ Ab ^ Ac 

{z-— a){z'- b){z'— c) z— a z-— b z — c 



and 



Ba ^_ Bb , _^ Be 



{z — a){z — b){z — c) z—a z — b z-^c 
The differential equation, therefore, takes the form 

Ac \ dw 



dhju, I Aa 
dz" ^ 



\z — a z — b z — c) dz 



+ 



f Ba ^ Bb ^ Bc\ w_ 

\2 — a z — 6 z — c) {z — a){z — ^ 



b ' z — cj (z — a)iz — b){z'- c) 
And since the coefficient of z^ in P(z) must equal 2, it follows that 

Aa + Ab + Ac = 2 



= 0 



(7-4) 



(7-5) 



Otherwise the constants Aa, Ab, Ac, Ba, Bb, and Be are arbitrary. 

Now at each of the points a, 6, and c there is a pair of characteristic 
exponents, say (a', a"), (/3', /3")^ and (y', y")?^^ respectively. In order to find 
a relationship between these exponents and them's and fl's, notice that since 

po = lim {z - a)p{z) = lim ^Aa + A, + Ac (f^) 



The pairs {a\ a"), (j8\ jS'O, and {y\ y") are solutions of the indicia! equations at the points a, 6, and 
c, respectively- 
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and 



qo = lim (. - ay-q{z) = Ij^ + (fzrf) + [^) 



1 



iz-b){z-c) 



Ba 



(a — b) (a — c) 
at 2= a, the indicial equation at this point is 



Ba 



p2 + {Aa - l)p + 7 7Y7 r= 0 

{a — b){a — c) 



But it follows from the properties of the roots of quadratic equations that the 
roots a' and a." of this equation satisfy the relations 



«' + «"= 1 -Aa 



oc'oc" = 



Ba 



{a — b){a — c) 



And we can show in exactly the same way that 



13' + 13"= 1 -Ah 



P'{3" = 



{b-a){b-c) 



y' + y"=l-Ac 



y'y": 



Be 



(c — a) (c — b) 



Upon using these relations to eliminate the and fi's in equation (7-4), 
we arrive at the Riemann-Papperitz equation 



dhv^ n-a'-a " ^ 1-/3' -/3" ^ l-y'-y'^ dw^ 
dz^ \ z — a z — b z — c / dz 



a'a"{a-b) ja-c) 
z—a 



+ 



13'^" {b- a) jb-c) , yV(c-a) jc-b) 



z-b 



z — c 



1 w_ 

J {z-a) {z- 



b){z-c) ^ 
(7-6) 
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Eliminating the A^s in equation (7-5) shows that the characteristic ex- 
ponents at the singular points of eqjuation (7-6) satisfy the relation 

a' + a"+ j3' + j3"+ y' + /= 1 (7-7) 

More generally, the sum of all the characteristic exponents at the singular 
points of any second-order Fuchsian equation is two less than the number of 
such points. This relation is called the Fuchsian invariant for the equation of 
order 2. 

In a similar way, it can be shown that if a Fuchsian equation with, at most, 
three regular singular points, has one of these points, say c, located atz = oo, 
this equation must be of the form 

dz^ \ z — a z — fc / dz 

L z — a z — b J {z — a) yz — b) 

where y' and y" still denote the characteristic exponents at c and equation 
(7-7) still holds. Since equation (7-8) can be obtained by formally taking 
the limit c— >oo in equation (7-6), we can say that equation (7-6) holds even 
when 0=00. Then with this understanding, equation (7-6) is the most general 
Fuchsian equation which has, at most, three singular points. 

7.2 RIEMANN P-SYMBOL 

When m; is a solution of the Riemann-Papperitz equation whose singulari- 
ties occur only at the distinct points a, 6, and c, we shall sometimes write 




(7-9) 



The right side of equation (7-9) is called the Riemann P-symboL The char- 
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acteristic exponents of the differential equation are listed below the correspond- 
ing singular point. (Any of the singular points can be at iufinity.) These ex- 
ponents must, of course, satisfy the Fuchsian invariant 

Finally, the independent variable is located in the fourth column. 

If we interchange any of the first three columns in the P-symbol (7-9), 
the notation still refers to the same equation. There are 3!= 6 ways in which 
this can be done. Similarly, interchanging the order of the exponents in any 
given column leaves the meaning of the symbol unchanged. Thus, for each 
arrangement of the points a, 6, and c, there are eight arrangements of the 
exponents. Hence, there are 6X8 = 48 different P-symbols which refer to the 
same equation and, therefore, have the same meaning. 

We shall now show that 

a b c \ 

J8' y + k z\ (7-10) 

a"-k jS" y"+k I 

when a, 6, and c are finite and 

6oo\ /ah »\ 

jS' y' 2|=(z-a)'^P| a'-A: /3' y' + A: z\ (7-11) 

/3" y" / V"-^ /3" y"+^ 



when c= 00. 

Equation (7-10) means that if u; is a solution of a Riemann-Papperitz 
equation and if we make the change of dependent variable 



/a 


h 


c 


PI a' 




y' 


V" 




y" 




w 



= (|^)'. (7-12) 
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in this equation, then the transformed equation (which has u as the dependent 
variable) is also a Riemann-Papperitz equation and the location of the singular 
points is left unchanged by this transformation. However, the v^naracteristic 
exponents at the points a and c are altered in the manner indicated by the 
symbols. Equation (7-11) is the corresponding transformation for the case 
where one of the singular points is at infinity. 

In order to prove that equation (7-10) holds, we first substitute equation 
(7-12) into equation (7-6). Then upon noting that 

\z — c/ L \z — a Z'-c) {z—a) {z — cjxz-^a z^c) J 

and 

(2-a) (2-c) (2-X) (2-a) (2-6) (2-c) y z-k) 

for \=a, 6, or c 

we find after combining terms that 

d^u ^ n-a'-a"+2k ^ 1-/3' -/3" ^ l-y'-y"-2A\ du 
d:^ \ 2 — a z — h z — c ) dz 

^ Ha'-k) ia"-k) (a-b) ja-c) ^ /3'IB"{b-a) (b-c) 
L 2— a z—b 

I iV + k) (V'+k) (c-g) (c-6)] a 

z — c J (2 — a) (2 — 6) (z — c) 

But comparing this with equations (7-6) and (7--9) shows that equation 
(7-10) holds. Equation (7-11) follows from equation (7-8) in the same way. 
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Having considered the transformations of the Riemann-Papperitz equa- 
tions under a change of dependent variable, we shall noYr show how this equa- 
tion transforms under a change of independent variable. In this case, the 
change of variable which transforms a Riemann-Papperitz equation into another 
Riemann-Papperitz equation is the nonsingular linear fractional transformation 

^""r^rf where ^Z)-BC 0 (7-13) 

studied in chapter 5. 

It is again convenient to describe this transformation in terms of the Rie- 
mann P-symbol. Thus, if t is the change of variable (7-13), then 




(7-14) 



where ai, 6i, and C\ are the images of the points a, 6, and c, respectively, under 
equation (7-13). For example. 



Aa±B_ 

In order to prove equation (7-14) we first recall that (see section 5.3) per- 
forming the transformation (7-13) is equivalent to performing in succession 
not more than four elementary transformations, each of which has one of the 
forms 



t = lz (7-15) 
t=k+z (7-16) 



t=\ (7-17) 



It can now be verified, by substituting in turn each of equations (7-15) to (7-17) 
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i 



into equation (7-6), that in each case the transformed equation is a Riemann- 
Papperitz equation with the same characteristic exponents as equation (7-6) 
and that the singular points of the transformed equation are the images under 
the transformation of the original singular points. Hence, equation (7-14) holds 
for each of the elementary transformations (7-15) to (7—17). But since the 
general nonsingular linear fractional transformation is equivalent to performing 
a succession of these transformations, it is clear that equation (7-12) must hold 
for this transformation also. 

7.3 TRANSFORMATION OF RIEMANN-PAPPERITZ EQUATION INTO HYPER- 
GEOMETRIC EQUATION 

We shall now show that the general Riemann-Papperitz equation (7-6) 
can always be transformed by the application of a number of transformations 
(each of which has one of the forms (7-10), (7-11), and (7-14)) into a certain 
standard equation (canonical form). The usefulness of this result is principally 
due to the fact that the transformed equation, which has a regular singular 
point at the origin, has a two-term recurrence relation at this point. As we have 
seen, this allows us to find an explicit expression for the series solution. 

In order to accomplish this reduction let w be any solution to equation 



where we suppose that the notation has been so arranged that a and b are 
always finite. We first introduce the new dependent variable v by 



(7-6). Then 




b 




(7-18) 



(z-ay'v 



if c = oo 



and then use equation (7-10) or (7-11) to show that 
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a b C \ 

i;-=P( 0 $" y' + a' z\ (7-19) 
\a"-a' ft" y+a' / 



We again change the dependent variable by using the transformation 



v = 



00 



{z — by'u ifc=oo 



(7-20) 



and then apply equation (7-10) or (7-11) to equation (7-19) to show that 



ah c 
u=Pi 0 0 y' + a' + p' z 

Va"-a' /8"-/8' V'+a' + p' 



(7-21) 



Now let us use the linear fractional transformation (discussed in section 
5.3) which maps the points a, 6, and c into the points 0, 1, and oo, respectively, 
to change the independent variable. Thus, a new independent variable t is 
introduced by 



(7-22) 



(When c=oo, we understand t to be the limit of this expression as c— » <», 
which is simply the first term in the right-hand member.) And in view of equa- 
tion (7-14) it follows from equations (7-21) and (7-22) that 



/ 0 



00 



u = Pl 0 0 y' + a' + (3' t\ 

-a' p"-p' y'+a' + /3' 



(7-23) 



211 



DIFFERENTIAL EQUATIONS 

The transformations (7-18). (7-20), and (7-22) can now be collected into 
the single formula 



w{z) = 



iz-a)"' {z-by u{t) t=Y^ forc = oo 



(7-24) 



The function u given in equation (7-23) is the solution to a Riemann-Papperitz 
equation which has only four nonzero exponents. Since the sum of these ex- 
ponents is unity, they can be characterized by three constants, say a, )3, and 
y. It is customary to define these constants by 

a = a'+p' + y' p=a'+p' + y" y= l + ct'-a" 

(7-25) 

Then equation (7-23) can be written as 



/ 0 1 °° \ 

u=pI 0 0 a ti 

\l-y y-a—p (3 / 



(7^26) 



But comparing equations (7-8), (7-9), and (7-26) shows that the Fuchsian 
equation satisfied by (7-26) is 



r i-(i-y) i-{y-a-fi^ da ro 0 , J u _ 



And upon rearranging this equation slightly, vye obtain the hypergeometric 
equation of Gauss ^ 

t (1-0^+ [y- {a+p+ 1) t]^-apu=0 (7-27) 

Its solutions^ which will be obtained subsequently, have been extensively 
studied. 



212 



RIEMANN-PAPPERITZ AND HYPERGEOMETRfC EQUATIONS 



We have, therefore, shown that any Riemann-Papperitz equation can be 
transformed into the hypergeometric equation {7—27) by introducing a change 
of variable of the type ( 7-24 ) . 

Hence, once the solutions to the hypergeometric equation (7—27) have 
been found, we can find the solutions w to any Riemann-Papperitz equation 
simply by using the transformation (7-24) to express them in terms of the solu- 
tions to the hypergeometric equation. 

However, in any specific case, it is usually more convenient to, rederive 
this transformation by using the Riemann P-symbol. Thus, consider the 
Riemann-Papperitz equation 

222(2-2)m;"-z(3z-2)m;' + 2(z-1)m;=0 (7-28) 

For this equation, 

PU) o./^ o\ 9(2)-: 



22(2-2) ' 22(2-2) 

Hence, its singularities are located at the points 2 = 0, 2 = 2, and 2 = 00. 
At 2 = 0 



po=lim [--^^ — It 1=""^ 7o=lim 
2(2 — 2) J 2 2-^0 



2-1 1 



^o.;5-2 2 

and, therefore, the indicial equation at this point is (see eq. (6-39)) 

The roots of this equation are 1 and 1/2. 
At 2 = 2 

and, therefore, the indicial equation is 

p2-2p = 0 
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The roots of this equation are 2 and 0. 

At 2=00 



po=Hm [2~zpU)]==limF2 + ,f 1 1=^ 
y j-,co[ 2(z~2) J 2 

1 

go= lim z^q{z) = ]im -= 1 

and, therefore, the indicial equation is 

p2 + |p+l = 0 

The roots of this equation are — 1/2 and —2. Hence, the solutions to equation 
(7-38) can be denoted by 

/O 2 a. 
w=pI 1 2 -1/2 z 
\l/2 0 -2 
It now follows from equation (7-11) that 

( 0 2 00 
0 0 0 
1/2 2 -3/2 
And it can be concluded from equation (7-14) that 

(/O 1 00 

0 0 0 

1/2 2 -3/2 
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where t = zl2. But upon comparing this with equation (7-26), we see that 

a = 0 — I y=| (7-29) 

Thus, the solutions to equation (7—28) can be expressed in terms of the solu- 
tions to the hypergeometric equation (7--'27) with the constants a, )3, and y 
given by equation (7-29), 

7.4 HYPERGEOMETRIC FUNCTIONS 

It remains to determine the solutions to the hypergeometric equation 
(7-27). We shall first seek a solution about the regular singular point z=0. 
Since the P-symbol for equation (7-27) is given by equation (7-26), it follows 
that the characteristic exponents at 2=0 are 0 and 1 — 7. Suppose first that y 
is neither zero nor a negative integer. Then the methods developed in chapter 6 
can be used to obtain a power series solution of the form 

u=^ ant"" (7-30) 

n=o 

which corresponds to the characteristic exponent zero. Upon substituting this 
into equation (7-27), collecting terms with like powers of t, and shifting the 
index ;i, the lowest one present, we obtain 

V fi(y+a-l)ani"''-|; {a + n-l){(3+n-l)an-it^^' = 0 

Hence, the ^ = 0 term shows that ao is arbitrary and we obtain the two- 
term recurrence relation 

an = - : — . , , -an-i forn = l,2, . • . (7-31) 

niy+n — l) 

where the division by n{y+ n — 1) is permitted since we have required that y 
be neither zero nor a negative integer and, therefore, the denominator can never 
vanish. Upon writing out equation (7-31) for successive values of n, multiply- 
ing the corresponding members of these equations together, and dividing 



Recall that it was shown in section 6,3' that the power scries solution corresponding to the largest characteristic 
exponent always exists. 
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out common factors, we find that 

. . . (a+n-l)][j8(/8+l) . . . (/3+n-l)] 

n![y(r+i) . . . (r+n-1)] 

And by using the generaUzed factorial function defined in equation (5—33), 
this can be written in the more concise form 



n!(y)„ 

Hence, the solution (7-30) is 

a=aoF(a, i8; y; t) (7-32) 

where we have put 

F(a,/8;y;0 = |;^^|#^«" for y ^ 0, - 1, -2, . . . (7-33) 

The function F(q:, p; y; t) is called the hypergeometric function^ and the 
notation used herein is universally accepted. The reason for calling this 
function the hypergeometric function is that when q:=1 and ^8=7, this series 
(7-33) reduces to llie geometric series. Thus, 

F(l,y;y; 0 = 



In fact, it follows from the binomial theorem that 



F(a, y; y; t)^F{y, a; y; t)= ^i^)a (7-34) 



for any number a. 
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Notice that if either a or )8 is zero or a negative integer, the series (7-33) 
terminates after a finite number of terms and, therefore, represents an entire 
function. In all other cases, a simple application of the ratio test (ref. 23) will 
suffice to show that it converges in the circle |^| < 1 and diverges outside this 
circle. 

We have, therefore, shown that, provided y is neither zero nor a negative 
integer, 

u=F{a,fi;y;t) (7-35) 
is a solution to the hypergeometric equation 

til-t)u''+[y-{a + p+l)t]u''-af3u=-^0 (7-36) 

at least in the circle |^| < 1. 

Since equation (7-36) is a Riemann-Papperitz equation, its solutions a 
can be denoted by the P-symbol 




(7-37) 



Also, inasmuch as the order in which the exponents are listed in a given column 
is immaterial, we can interchange those in the first column to obtain 

1 00 \ 

0 a t \ 



u=P\ \-y 



Hence, it follows from equation (7-11) that 
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u 




0 



1 



00 



t 




(7^38) 



Notice that the P-symbol in equation (7-38) is in canonical form. It, there- 
fore, denotes a solution to the hypergeometric equation whose exponents at 
the points 0, 1, andoo are 0,7—1: 0,y— a — /3; anda+l — — y, respec- 
tively. And we can choose this solution to be the hypergeometric function F. 
Hence, upon comparing equations (7—35) and (7—37) with the P-symbol in equa- 
tion (7-38), we find that 



is also a solution to equation (7-36) provided, of course, 2—7 is neither zero 
nor a negative integer. Since the hypergeometric series converges for |f| < 1, 
the function (7-39) must satisfy the differential equation in this region. Notice 
that if 7= 1, the solutions (7-35) and (7-39) are identical. In fact, equation 
(7-37) shows that, in this case, equation (7-36) has equal exponents at ^=0 
and, therefore, one of the solutions composing the canonical basis at ^=0 must 
contain logarithmic terms. Next, if y is any integer other than unity, either 
7 or 2 — 7 is either zero or a negative integer. Thus, either the hypergeometric 
function (7-35) or the hypergeometric function (7-39) is undefined. The remain- 
ing equation provides a solution to the differential equatiofi. Finally, if 7 is not 
an integer, both equations (7-35) and (7—39) are solutions to the differential 
equation in the circle |^|<1. Since the series expansion for equation (7-35) 
begins with and that for equation (7-39) with t^~'^, they must also be linearly 
independent solutions. 

Interchanging the exponents in the second column 01 equation (7—37) leads 
in the manner described above to the solution 



in the domain |^| <1. And interchanging both the exponents in the first column 
and those in the second column leads to a fourth solution 



a=^^-^F(a+l-7,)8+l-7; 2-7; t) 



(7-39) 



(^-l)^-«~^F(7-/3,7-a; 7; t) 



(7-40) 



j^=^i-'r(^-l)v-a-^/r(l-/3, 2-7; t) 



(7-41) 
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in the domain |t| < 1. But, at most, two of these four solutions can be linearly 
independent. If y is not an integer, there exists a linear relation connecting 
any three of them. And, if y is an integer, the two solutions which exist can differ 
only by a multiplicative constant. 

Another set of four solutions can be obtained by interchanging the points 
0 and 1 by means of the transformation z= 1 — f. Thus, for example, equation 
(7-37) is equivalent to the equation 

1 0 00 

u—P\y — a'-p 1 — y a t 
0 0 j3 

Upon applying equation (7-11) to this equation twice in succession, we obtain 

1 0 00 

a=(^-l)v-«-^r'-Y/>j 0 0 t 

^a + ^ — y y — 1 1 — a 

It now follows from equations (7-13) and (7-14) that the transformation z= \—t 
maps the points 1, 0, and oo into the points 0, 1, and oo^ respectively, and leads 
to the expression 

(^0 1 00 

0 0 l-j3 \-t 

— y y— 1 1— a 

Since this /^-symbol is in canonical form, it represents a solution to a 
hypergeo metric equation which we can again choose to be F. Thus, we find 
after comparing exponents with equations (7-35) and (7-37) that 

u=(t-l)>'-«-^^^->'F(l-/S, 1-a; l + y-a-8; \-t) (7-42) 
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Notice that the hypergeomelric series in the solution (7-35) converges in 
the circle |j| < 1, while that in the solution (7-42) converges in the circle 
|f — lf< 1. By systematically exploiting the technique used above, Kummer 
(1810 to 1893) obtained 24 solutions to the hypergeometric equation (7-36), 
each of which is expressed in terms of the hypergeometric function F. In 
each of these solutions the variable is one of the quantities 1 — ^, (^-^l)/f, 
r/(l — f), lit J and (1 — O""^- Since the function F with variable t converges 
in the unit circle H < 1, ihese solutions will converge in one of the regions 
shown in figure 7-1. Each series will converge in the appropriate shaded region 
and diverge outside it unless the series terftiinates; in which case, it will 
converge in the entire plane. Of the 24 solutions, four converge in each of 
the regions shown* Of course, only two solutions can be linearly independent 
in any given region. Some of the re^ons shown in the figure overlap. Hence, 
there are numerous relations among the various 24 solutions obtained by 
Kummer. These relations not only provide useful identities among hyper- 
geometric functions but also provide formulas which can be used to ana- 
lytically continue the solutions of the Riemann-Papperitz equation from one 
region of the plane to another. Thus, it can be shown, for example, that when 
y is neither zero nor a negative integer, the identity 

F(a, ^; y; 0 = (1 - t)y-^-^F{y-a, y-p; y; 0 (7-43) 

holds in the domain \t\ < 1. An example of an identity which holds in the inter- 
section of the regions shown in figures 7-I(a) and (b) is 

F {oc,/3; y; 0 = (1 - 0""^ (a, y-fi; y; for \t\ < I and \t\ <\l-t\ 

It is frequently convenient to express the hypergeometric function as an 
integral. This can be done when £^ry>S^fi>0 atid \t\ < 1. In order to arrive 
at this result, we substitute equation (5-35) into equation (7-33) to obtain 
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(3) 





(6) 



(a) The region 0 ^ I'l <1- 



(c) The region 0 ^ |1 -t\ < 1. 



(e) The region 0 ' 



<1. 






ii) 

(b) The region 0 < 
(d) The region 0 < 
(0 The region 0 «^ 



<I. 



1 



t 



<1. 



< 1. 



Figure 7-1. — Re©ons of convergence for hypergeometric series. 
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Since it follows from equations (5-37) and (5-38) that 

for^*y>^^g../3>0 

equation (7-44) can be written as 

Upon interchanging the order of integration and summation (see section 
5.6), we find that 

But the series can be summed by using equations (7 --33) and (7-34) to obtain 
the integral representation 

F (a, P; y; 0 - r(^) r (y^^) /J r^'Hl-r)y^^-'^{l-n) ''<^dr 

for^y >^/3>0and|f| < 1 

which was discovered by Euler. Since this integral exists and represents an 
analytic function for all values of t except where t is real and larger than 1, 
it provides an analytic continuation of F(a, J3; y; 0 from the unit circle 
|r| < Wo the entire t-plane cut along the positive real axis. Barnes obtained 
the more general integral representation 

F (a, ^; y; 0 =— ^.^^^ J^^^ r (y ) ("O^^z 

where |arg (— ^)| < tt and the integration is to be carried out along any path 
which lies to the right of the poles of r(a+z) r(p + z) and to the left of the 
poles of r(— z). 
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The six functions F{a±l, p; y; t),F{a,fi±l, y; t) , and F{a, fi;y±l;t) 
are said to be contiguous to F(a, fi; y; t). Gauss proved that there is a linear 
relation between F{a, ft; y; t) and any two of its contiguous functions, the 
coefficients being linear polynomials in f. Some examples of these relations are 

y (1 - t)Fia, P; y; t) = {p-y)tF{a, /3; 7 + 1; 0 +rF(a- 1, /3; y; t) 

{p-a)F{a, p; y; t) --pF{a, 0 + 1; y; t) -aF{a+ 1 , /3; 0 

The derivative of a hypergeometric function is also a hypergeometric 
function. In order to show this, notice that the series (7"-33) can be differentiat- 
ed term by term within its circle of convergence to obtain 

dt (r)n(n~I)! 

Upon shifting the index by putting k=n — \y this becomes 

dF- (a)...(/3)... 

But since it follows from definition (5-33) that (a)i+i 5= a(a+ l)jt, (^)jt+,= 
/3(i3+l)fc, and (y)fc+i = y(y+ equation (7-45) shows that 



40241=11=22 (7-46) 
at y 



More generally, the Jacobi identity 

Pi y; 0] = {a)nt--'F{a + n, P; y; 0 ( 7-47) 

can be established by multiplying both sides of the identity by t^~° and then 
verifying that the left side satisfies the hypergeometric equation with param- 
eters a + fiy Pj y. 
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There are many other relations connecting the hypergeometric functions. 
The reader can find these tabulated in reference 26 and discussed in somi^ 
detail in reference 27. Many of the known functions, such as the elliptic inte- 
grals of the first and second kind, the inverse sine, etc., can be expressed as 
hypergeometric functions. 

7.S GENERAUZED HYPERGEOMETRIC FUNOIONS 

The concept of hypergeometric function can, itself, be generalized. To 
this end, notice that in the definition of the hypergeometric function 



the numerator and denominator of the coefficient of z"/«! contain only products 
of generalized factorial functions. Hence, it is natural to define the generalized 
hypergeometric function pFq by 

pFgiai^at. . . .,ap; 71,72 ^^^^^^ 2 It \ L\ 

«fo^- yy^)^ • • • vr^)* 

(7-48) 

provided the series converges.^^ The numbers p and q are nonnegalive integers 
which denote the number of parameters in the numerator and in the denomi- 
nator, respectively. Thus, the ordinary hypergeometric function F is a 2F1. 
Since the parameter /3 cancels out in the numerator and denominator in 
equation (7-34) , we see that 

where we indicate that there is no parameter in the denominator by 
inserting a dash. The function iFi is treated in the next chapter. The generalized 
hypergeometric functions are studied in considerable detail in reference 27. 



"This series \%i]| always converge in the unil ci»-cle if ^ = 1. and it will converge in the entire plane if ^ >/;+ 1. 
Tlic other rases are more complex. 
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7.6 LOGARITHMIC SOLUTION TO HYPERGEOMETRIC EQUATION 

We have found two linearly independent solutions to the hypergeometric 
equation (7-36) in a neighborhood of f — 0 for the case where y is not an 
integer. However, when y is an integer, only one solution has been found. 
The remaining solution can be found by the methods of chapter 6. Thus, for 
example, when y is a positive integer, Ui — F (a, /8; y; t) provides one solution 
to the hypergeometric equation (7-36); and the methods of chapter 6 show 
that if neither a nor /3 is a positive integer smaller than y, a second linearly 
independent solution is given by 

u. = F (a, P; y; 1) In ^ -f ., "^^^J!" 

+ S^47^[^ ict,n) + H{p,n)-H {y,n)-Hi\,n)]t'' 

where the finite sum is to be omitted when y= 1 and we have put**^ 

We can obtain the second solution for the case where y is zero or a negative 
integer in the same way by starting with the solution 

ui = t'-yF{a+ 1 - y, )3+ 1 - y; 2 - y; 0 

7.7 SPECIAL RIEMANN-PAPPERITZ EQUATIONS 

The classical Jacobi differential equation 

(l-z2)u;"+ [fe-a-(a+6 + 2)z]u;' + n(ri+a + 6+l)u;=0 (7-49) 



"The funrtion drfined in eq. (6-89) is identical Ik H(\. n). 
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is a particular Riemann-Papperilz equation with singular points at 2=±1, oo. 
It is readily estabb'shed that in this case 




\ 

z\ (7-50) 
;i + a + 6 + l / 



This equation can be put into canonical form by the change of independent 
variable t= (1 -2)/2. Thus, 

(0 1 00 

0 0 -n 

-a -b n+a+6+1 

Therefore, when a is not a negative integer, a particular solution wi to the 
Jacobi different^lal equation is 



= F {^n, n+a + 6+1; a+1;— ) (7-51) 



Equation (7-51) satisfies the differential equation within the circle |1 — z( <2 
for all values of the parameter n. But if n is a nonnegative integer, the hyper- 
geometric series terminates after a finite number of terms. For such values of 
the Jacobi polynomial is defined as 

f^'''''^^^)^^'^^— for ,7 = 0, 1,2, . . . 

(7-52) 

A convenient expression for these polynomials is provided by the Rodrigues 
formula 

n"''K^)=-^(l-^)-"(l+z)-''^[(l-z)«-^"(l + z)'>+''] (7-53) 
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This formula was obtained for the special case of Legendre polynomials (in- 
troduced below) by Olinde Rodrigues in 1816. In order to derive this result, 
we use equation (7-34) together with the Jacobi identity (7-47) to show that 

r«(l-0-^|!j[(l-0^^"^«^"] 

-(a+l)„(l-0-^F {a+l + n,-n-b;a+l;t) (7-54) 

But it follows from equation (7-43) that 

{l-ty^F {a+l + n,-n-b;a+l;t) = F (-/i,a+l + ;i+6;a+l;t) 

Hence, after substituting this into equation (7—54) and making the change of 
variable f= (l~z)/2 in the resulting expression, we find, upon comparing the 
result with definition (7-52), that the Rodrigues formula (7-53) holds. 

A number ui important equations which have been extensively studied 
are special cases of Jacobi's equation. Thus, when a =6, equation (7-49) 
reduces to the ultraspherical differential equation 

{l-z^)w''-2 {a+l)zw' + n (n + 2a + l)u;=U (7-55) 

A solution to this equation is given by equation (7-51) with a = 6. But, 
when re is a nonnegative integer and the series terminates, it is customary to 
use a different normalization factor from the one used in equation (7-52) and 
to express the solution in terms of the Gegenbauer polynomial 




(7-56) 



The polynomial obtained directly from eq. (7-52) with a = b is sometimes called the ultraspherical 
polynomiaL 
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where we have put a=a+ (1/2). 
The Tschebychev equation 



[1 - z^)w" - zw' + n^w= 0 



(7-57) 



is, in turn, a special case of the ultraspherical equation (7-55) with a= 
— 1/2. One solution to this equation is therefore given by equation (7-51) 
with a=6=— 1/2. However, when n is a nonnegative integer, it is again 
customary to change the normalization and define the Tschebychev polynomial 
(of the first kind) Tn in terms of the Jacobi polynomial (or ultraspherical poly- 
nomial) by ^ 



Another important special case of the ultraspherical equation occurs 
when we put a = 0 to obtain Legendre^s equation 



One solution to this equation is given by equation (7-51) with a = fe = 0. 
Thus, we define the Legendre function of the first kind Pn by 



And since this function is a polynomial when n is a nonnegative integer, it is 
then called the Legendre polynomial. Thus, the Leg;endre polynomial is a Jacobi 
polynomial with a = 6 = 0. 

A second (suitably normalized) linearly independent solution to equation 
(7-58) about z=l is called the Legendre function of the second kind and is 
denoted by Qn- If n is an integer, Qn will involve logarithmic terms. 

Notice that Legendre's differential equation (7-58) (and, in fact, more gen- 
erally, the ultraspherical differential equation (7-55)) is invariant when z is 
replaced by —2. This suggests that we transform equation (7-58) by introducing 

^ It is not hard to show that Tn satisfies the relation T„ (cos 0)= cos n 6, and this relation is often used to define 
this polynomial. 




(l-^)w"-2zw' + n {n+l)w=0 



(7-58) 




(7-59) 
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the new independent variable t=z^. The equation then becomes 

But this is again a hypergeometric equation whose parameters a, jS, and 7 are 
now -^(1/2 )n, (1/2) (n+ 1), and 1/2, respectively. And since y is not an inte- 
ger, we can conclude from the results of the preceding section that this equation 
has two linearly independent solutions Wi and Wz about ^ = 0 which are given by 
equations (7-35) and (7-39), respectively. Thus, 

^ / n n + l 1 J\ 



„ / n+l n + 2 3 „\ 
u^ = zF{-—,~-;z^j (7-61) 

They converge at least within the circle |z| < 1. When n is a nonnegative 
integer, the series for Wi will terminate for even values of n and that for W2 
will terminate for odd values of n. However, the polynomials obtained in this 
manner must be identical, to within a constant factor, with the Legendre 
polynomials Pn(z). 

The associated Legendre equation 



(l-z2) w"'-2zw' + ^n («+l)-Yzr^J w=0 (7-62) 

reduces to Legendre's equation when m=0. It is a Riemann-Papperitz equa- 
tion for all values of m. Its P-symboi is 

/I -1 00 

w=pI (112) m (1/2) m -n 
V(l/2)m -(l/2)m n+l 

But upon transforming this to normal form, we find that 
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/ 0 0 06 

•I 0 



u;=(z2-l)'''/2pl 0 0 m-n (l-z)/2 

Vm —m m + n+1 

If we let u be the transformed dependent variable, then 

w^iz^-D^l^u (7^3) 

and 



00 \ 

m — n (1— z)/2 



0 


0 


0 


0 




— m 




m+n + 1 



^1 00 

0 m — n 

—m m+n+1 



Hence, u satisfies the equation 

(1-22) u"-2 + 2^'+ („+;„+i)^=o (7_64) 

But when Legendre's equation (7-58) is differentiated m times, we obtain 
(l--z')-^^-2 (^+l)z-^^+(n-/n) (n+/n+l)-^=0 

(7-65) 

Since Pn and are two linearly independent solutions of equation 
(7-58) about z=l, we see upon comparing equations (7-63), (7-64), and 
(7-65) that 
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and 

0}r(z)=(;:^-l)'"/^-^[<?n(z)]. 

are two linearly independent solutions to equation (7-62) about 2=1. They 
are called the associated Legendre functions of the first and second kind, 
respectively. 
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Conflnent Hyper^eometrie Equation and 
Confluence of Singularities in 
Riemann-Papperitz Equation 

Having studied equations whose only singular points are regular singular 
points, it is natural to approach the study of equations with irregular singular 
points by applying a limiting process wherein two or more regular singular 
points of an equation are allowed to approach one another. The process, 
whereby two or more singular points in any linear differential equation are 
allowed to come together in such a way that at least one of the corresponding 
exponents becomes infinite, is called confluence , provided the limiting form of 
the differential equation ^ists. 

8.1 CONFLUENCE OF SINGULARITIES IN RiEMANN-PAPPERltZ EQUATION 

We shall apply this process to the Riemann-Papperitz equation whose 
singular points are located at 0, 6, and by letting the regular singular point 
b approach the regular singular point at Now if we are going to allow the 
exponents at the points b and oo to become infinite, we must prescribe the 
manner in which they approach infinity. This can be done by letting these 
exponents be functions of 6 whose values approach infinity as 6 oo. If we 
suppose that the exponents are polynomials in 6, it is not hard to sho^y that the 
requirement that the limiting form of the differential equation exist implies 
that the exponents be, at most, linear in b. Now equation (7-~8) is the genwal 
Riemann-Papperitz equation with one of its singular points at ^. If we require 
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that the two singular points in the finite part of the plane are at 0 and 6 and if 
we suppose the exponents at 6 are P[ + bfi2 and)3{' + 6^2' and those at oo are 
yl+6y2 and yl' + 6y2\ this equation becomes 



dz^ I z z — b \ dz 



L z 6 — z J (0 — z)z 

(8-1) 

But if the coefficient of u; is to remain finite as 6—^00, we must require that 

m' -7272=0 (8-2) 
Then upon taking the limit in equation (8-1), we obtain the equation 



+ I ~ — \-P2P2 I "^ = 0 (8-3) 

where we have put 

a,=y[y^' + y['y^+il-a'-p'M'-ia" + p[')p;, 

This equation has a regular singular point at z = 0 and an irregular singular 
point atz = Qo. 
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8.2 TRANSFORMATION TO KUMMER'S CONFLUENT HYPERGEOMETRIC EQUA- 
TION 

Making the change of dependent variable 

?i; = 2«"e-^i''f£ (8-4) 
transforms equation (8-3) into the equation 

z^+[y-(/3;'-/3;)z]f-a.« = 0 

where we have put 

y=l + a"-a' (8-5) 
And, iP^ P2 5^)82, the change of independent variable 

f=(^;'-^i)2 (8-6) 

leads to Kiimmer^s confluent hypergeornetric equation 

iPu , , . du ^ 

where a = ail ^ ' 

Thus, once the solution to equation (8-7) is known, we can find the solu- 
tions to any equation of the form (8-3). 

8.3 SOLUTIONS TO KUMMER'S EQUATION: CONFLUENT HYPERGEOMETRIC 
FUNCTIONS 

We shall, therefore, seek a solution to Kummer's equation about the regu- 
lar singular point ^ = 0. Just as in the case of the hypergeornetric equation of 



•Mf /3" — /3'. the rharifie of in<lepen(lenl variable 2= (T^/Iftai) and ihe rlianj:;e of de|)endent variable // — *'"'*'*^t' 
lead to the equation T(</«i?/</r') + (2y — 1 — r) (dvldr) — ((2y — 1 )l2]v = 0, which is a special case of eq. <8-7). 
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Gauss, the characteristic exponents at this point are 0 and 1 — y. We again 
suppose first that y is neither zero nor a negative integer. Then equation (8-7) 

has a solution of the form U|==2an^'', which corresponds to the exponent 

n = 0 

p = 0. And we find, in the usual way, that 

n=0 n-t 

Therefore, ao is arbitrary and the recurrence relation is 

for n-l 2, . . . 

which can be solved to obtain 



an = — 77— 7-ao tor n= 1,2!, . . . 
nl{y)n 

Hence, by using the generalized hypergeometric notation, the solution Ux 
can be expressed in the form 



"i = ao iFiia; y; t) (8^) 

where the function 

= (8-9) 



is called the Pochhammer-Barnes confluent hypergeometric function. Siiice the 
only singularities of equation (8-7) are at r = 0 and t^oo. the solution (8-9) 
must be an entire function. 

Other commonly used notations for iFi{a; y; t) are M{a; y; t) and <I>(a; 
y; t). A complete discussion of confluent hypergeometric functions is ^ven in 
reference 28, 
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Notice that by putting t = zip in the hypergeometric equation of Gauss 
(eq. (7-36)), we obtain the equation 

And upon taking the limit /3-* » in tliis equation, we arrive at the confluent 
hypergeometric equation (8-7). On the other hand, by putting t = 2//3 in the 
hypergeometric function of Gauss (defined in eq. (7-33)), we obtain 



And 



smce 



we see that at least formally 

Hm F ^a, p; y; ^ = iFi (a; y; z) 

In a similar way, if y is not a positive integer, consideration of the series corre- 
sponding to the exponent 1 — y shows that 

U2^t'-y iF,(a+l-y; 2-y; t) (8-10) 

is also a solution to equation (8-12) 

Thus, if y is not an integer, equations (8-9) and (8-10) provide a funda- 
mental set of solutions to equation (8-7). But if y is equal to 1, these two solu- 
tions are identical And if y is an integer other than 1 , one of the hypergeometric 
functions in equations (8-9) and (8-10) is undefined and the other one provides 
a solution to the differential equation. However, whefiiy is a positive integer and 
a is not a positive integer smaller than y, the other linearly independent 
solution is given by 
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"=.F,(a; y; t) In r- V iilii-yl=ll ^ 



(a) 



where the finite sum is to be omitted when y= 1 and H{a, n) is defined in 
section 7.6. A corresponding result holds when y is a nonpositive integer, and 
the remaining cases should he treated individually by the methods of chapter 6. 

8.4 WHIHAKER'S FORM OF HYPERGEOMETRIC EQUATION 

There is another standard form into which equation (8-7) (and, therefore, 
as a consequence, eq. (8-3)) can be transformed. To obtain this equation, we 
make the change of variable 



in equation (8-7) to obtain the equation 



1/1 \ K^diiz) 



(8-11) 



(8-12) 



In order to introduce standard notation, we put 



1 



^=9 y — oc 



(8-13) 



and 



m = ^ (y-1) 



(8-14) 



to get Whittaker$ confluent hypergeometric equation 
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/ 



+ 



4 



(8-15) 



It follows from equations (8-8), (8-10), (8-11), (8-13), and (8-14) that if 
2m is not an integer 

Mfc. m(0 = r^«+(i/2)e-.(i/2)f ^1 + m - A; 2m + 1; (8-16) 

and Mfc, -m(0 are a fundamental set of solutions to equation (8-15) in the 
domain 0 < |^| < oo. 

The notation Mk,m is used in reference 25, The Whittaker's function 
, m is defined by 



fy, , X r(— 2to) , . , Y{2m) , . 



1\ 



2) 



Since Whittaker's equation (8-15) is unaltered if we replace A: by — A: 
and t and — ty it follows that 



W^M^H. m (- 0 and r = M^fc, ^«(- 0 (8-17) 

are also solutions to equation (8-15) in the region 0 < < oo. And since this 
equation can have, at most, two linearly independent solutions, there must be 
constants Ci and C2, such that 

m(-0 = CxM^^M + CsA/fc, -m{t) (8-18) 

provided 2m is not an integer. But equations (8-9) and (8-16) show that 
Mfc,m(t) and m(- 1) behave like ^^+(1/2)^ that Mk, ~m behaves like r '"^^i'^) 
in the neighborhood of f = 0, and that 
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Hence, equation (8-18) can hold only if C2 = 0 and Ci = (— 1 ) 'n+(x/2)^ Therefore, 

But substituting equation (8-16) in this equation shows that 

e'iFx(^ + k+m; I +2m; - = iFi(^- k+ m; l + 2m; 

And upon using equations (8-13) and (8-14) to express k and m in terms of 
a and y» we obtain Kummer's first formula 

iFi (a; y; 0 = iFi (y - a; y; - 0 (8-19) 

This equation holds even when y is a positive integer, for in this case, w^ 
could have replaced Mk,~-m by the appropriate logarithmic solution and 
carried through the proof in the same way. 

8.5 LAGUERRE POLYNOMIALS 

if the parameter a in equation (8-7) is zero or a negative integer, the 
solution iFi(a; y; t) (defined in eq. (8-9)) terminates after a finite number 
of terms and becomes a polynomial. This polynomial differs from the gen- 
eralized Laguerre polynomial 

(/)==: ^^^^^^% Fi(~n;l + 6; t) forn = 0, 1,2, . . . (8-20) 
nl 

only by a normalizing factor. When 6 = 0 in equation (8-20), we obtain the 
simple Laguerre polynomial Ln defined by 

L„{t) = iFi{-n; 1: t) 

Equations (8-9) and (8-20) show that 
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And since (— n)yn!= (— l)J7(n — 7)! 



and 



^.<')-|^7i^ (8-22, 



8.6 BESSEL'S EQUATION 

An important special case of equation (8-3) occurs when 

a — -a —p 



a, = 2;(a"+i) = (p+i)2,- 



The equation 



(8-23) 



z^w''+zw'+ {z^-p^)w = 0 (8-24) 



obtained in this manner is called Bessel's equation. When p is not a negative 
integer, the methods of chapter 6 can be applied in the usual way to show that 
(see section 7.5) 



(8-25) 
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is a solution to equation (8-24) about the regular singular point 2=0. However, 
it is conventional to multiply this solution by the normalization factor 
[2^r(l+p)]~^ and to use equation (5-35) to eliminate the generalized factorial 
function in the denominator. When this is done, we obtain the suitable nor^ 
malized solution 

wi^Jp (8-26) 



where 



,t'o^!r(i+^+p)U/ 



(8-27) 



is the BesseVs function of the first kind of order p. Notice that this function is 
defined even when p is a negative integer. And since 2=0 is the only finite 
singular point of the differential equation, the series must converge in the 
entire plane. Although Bessell functions were used by both Leonard Euler and 
Daniel Bernoulli before Bessel was born, the German astronomer Fredrick 
Wilhelm Bessel was the first to make a detailed study of them. 

Since the function in equation (8-25) differs from Jp only by the normaliza- 
tion factor [2Pr(l + p)]"^ when p is not a negative integer, it follows that 



>/p(^)= P^^^^ o/^i (-; l + p:-|^) forpT^-l, 



(8-28) 



On the other hand, we know that equation (8-24) can be transformed into 
Kummer*s confluent hypergeometric equation (8-7) by using the change oi 
variables given by equations (8~4) to (8-6). 

The solution Jp can, therefore, be expressed in terms of a linear combina- 
tion of solutions of equation (8-7). Thus, if p is not an integer, it follows from 
equations (8-4) to (8-6), (8-8), (8-10), and (8-23) that 

Jpiz)^AzPe-^^iFi ( p + H, l + 2p; 2^2 ] + Bz-Pe-^^ tFi (4-p; l-2p; 2^2 ) 
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But upon comparing the behavior of these functions at z=0, we find, when 
p is not an integer, that this equation can only hold if fi=0 and that 
/4=[2pr(l + p)]-». Hence, 

Comparing this with equation (8-28) shows that 

oFi ; l + p;-j) = e-'-^iFi + l + 2p; 212) 
Then by putting ^=12 and q; = p+ (1/2) , we obtain Kummer's second formula 
oFt a + 1; i = e-t iF, (a; 2a; 20 

When p is a negative integer, there is a close relationship between Jp 
and J^p. Thus, suppose p = — n for n= 1. 2, . . . Then since the F-function 
has poles at each of the nonpositive integers, all the terms in the sum (8-27) 
will vanish for k< n; and we obtain 

k=n ^ / \ ' 

But this becomes, upon shift of index from k to k — n, 

I ( \ (-1)'^+" / z \ 

•'-"^'^ ^,ik+n)\r{l + k)\2 I 

Hence, it follows from equation (5-36) that 

y_„(2) = (-l)«y„(2) for ri=l,2, . . . (8-29) 
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Since wi=Jp is a solution to equation (8-29) for all values of p and since the 
parameter p enters equation (8-24) only as p^, the function 

wo=J^piz) (8-30) 

must also be a solution to this equation for all values of p. When p is an integer, 
equation (8-29) shows that the solutions Wi and W2 are not linearly independent. 
However, for any noninlcegral value of p, consideration of the behavior of the 
functions Jp and J^p in the neighborhood of 2 = 0 shows that Wi and W2 consti- 
tute a fundamental set of solutions. In order to obtain a second linearly independ- 
ent solution to equation (8-24) when p is an integer, notice that for any value 
of p 



zVp+zJ'p+ (22-p2)yp=o 

zVi;+2yip+(22-p2)y_^=o 



(8-31) 



Since the series (8-27) is uniformly convergent, it can be shown that Jp, J^p, 
and their derivatives with respect to z are all differentiable with respect to the 
parameter p. Hence, upon differentiating equations (8-31) with respect to p 
and subtracting the result, we obtain 



z'jp+zjf;+ {z'-p')/p=2p[jp^ (-i)v-p] 



(8-32) 



where we have put 



dp ^ ^ dp 



By taking the limit as p->n in equation (8-32) and using equation (8-29), 
we find that the Bessel function of the second kind 



.dp ^ ^ dp 



(8-33) 



is a solution to equation (8-24) with p= n. But upon substituting equation (8-27) 
into this expression and noting that 
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~^^=i-l)''^'k\ forA: = 0, 1,2, . . . 
it follows after some algebraic manipulation, which we shall omit here, that 
F„(z) -- {y+ In -j J„ iz) - - ^ (2) 

where the finite sum is to be omitted if n = 0, Hk is defined by equation (6-89), 
and y is E uteres constant defined by 

y=lim(//fc- In A) = 0.5772156649 . . . (8-35) 

It is easy to see from equations (8-27) and (8-34) that Yn and Jn are a funda- 
mental set of solutions. 

It is convenient to extend the definition (8-33) of Fn to nonintegral values of 
p. This is now done by putting 

y,(z) COSp77-y-,(z) 

^ sm pn \ ^ / 

when p is not an integer. Then Yp and Jp are a fundamental set of solutions. 
And both the numerator and denominator of this expression vanish when 
p is an integer. But by using L^Hospital's rule, we find that forn = 0, 1, 2, . . . 

lim y,(z) = Um JjLOospn^^ dp dp ^ 

p-^n p^n sm pTT p^n TT COS pTT 

TT p^n \ dp COS pjT dp / TT P^n I dp ^ dp ] 

And comparing this with equation (8-33) shows that definition (8-36) is indeed 
an extension of definition (8-33). 

245 



DIFFERENTIAL EQUATIONS 



For large values of z with | arg z\ < tt, the Bessel functions Jp and Yp 
behave like 



^«~(4)""-(^-f-f) 



(8-37) 



However, it is sometimes convenient to have solutions to BesseFs equation 
which tend to zero exponentially as \z\ — > in the entire half plane J^z > 0 
or in the half plane z < 0. But since equations (8-37) show that for large z 



Jp{z)±iYp{z) ^ ) e^«^-<^^/2)-K^/4)] 

we see this property is possessed by functions Jn±iYp. For this reason, the 
Hankel functions of the first and second kind H^^^ and //^\ respectively, are 
defined by 



Hfiz)=Mz)-iYpiz) 

It is not hard to show that these solutions are a fundamental set. 
In a number of applications, we encounter the equation 

z^w' ' + zw'-{z^ + p^)w=0 (8-38) 

which is obtained from BesseFs equation by replacing z by iz. Although Jp(u) 
and Yp{iz) are a fundamental set of solutions of equation (8-38), it is convenient 
to introduce new functions which are real for real values cf z (at least for real 
values of p). To this end the modified Bessel functions of the first and third 
kind Ip and Kp^ respectively, are defined by 

/p(^)=e-(^-/"^)yp(i^ 
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Kpiz) =^ e«P"/2)//<')(iz) = f e«^/2) y^^^i^^^ + iYp{iz)] 

There are a number of useful relations between the Bessel functions and 
their derivatives. Thus, it follows from equation (8-27) and equation (5-31) 
that 

But upon differentiating both sides with respect to z, we find that 

In a similar way it can be shown that 

^ z-^]p{z) =^-z-Pjp^i{z) (8-40) 
After carrying out the differentiations in equations (8-39) and (8-40), we obtain 

z^^'^zjp^i — pjp (8-41) 

z^=-zjp^i + pjp (8-42) 

And by adding and subtracting these equations, we find 

/' 

2^=Jp-i-Jp+t (8-1.3) 



and 



2pjp=zjp-i + zjp+i (8-44) 
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The formulas (8r-39) to (8r-44) are very useful when dealing with Bessel func- 
tions. They also apply to the Bessel functions Kp, H^^\ and H^^K However, 
they must be modified sli^tly for the functions Ip and Kp (due to the presence 
of iz) . 

A much more complete treatment of Bessel functions can be found in 
reference 29. 

8.7 WEBER'S EQUATION 

Another equation, which has been extensively studied, can be obtained 
from equation (8-3) by putting 



« -| «" = 0 ^r = -^;=| «. = -| (8-45) 

to get 

... . 1 .. , 1/1 



zw 



and then making the change of independent variable 



^^f' (8-47) 

to obtain Weber s equation 

This equation was first studied by Hermite (1864) and then by Weber. lis 
solutions are called parabolic cylinder functions or W eber functions. 

Since equation (8-46) can be transformed into the confluent hypergeo- 
metric equation (8-7) by the change of variables (8-4) and (8-6), equation 
(8-48) can be transform.ed into equation (8-7) by the change of variables (8-4) 
to (8-6) and (8-47). Hence, the solutions to equation (8-48) can be expressed in 
terms of the solutions to equation (8-7). Therefore, use of equations (8-4) to 
(8-6), (8-8), (8-10), (8-45), and (8-47) shows that a fundamental set of solu- 
tions to Weber's equation (u;i, Wt) \s given by 
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,^., = e-<«/^>^^A (-||;^ C^) (8-49) 



W2 = e-^"* 



>^^C'^.F.(-V'llC'=) (8-50) 



Notice that if n is a positive even integer, the hypergeometric function in 
equation (8-49) terminates and becomes a generalized Laguerre polynomial; 
while if n is a positive odd integer^ the hypergeometric function in equation 
(8-50) becomes a generalized Laguerre polynomial. Thus, it follows from equa- 
tions (8-20), (8-49), and (8-50) that, if n is a positive integer, equation (8-48) 
has one suiuiiun w^a of the form 

t^3=e-<»/^^i'//„(0 forn-1,2, . . . (8-51) 

where //« is the nth Hermite polynomial^ which is defined in terms of the gen- 
eralized Laguerre polynomials by 



^=0,1,2,. . . (8-52) 



//2Jt^l (^) = (- 1 )^^22'^^'A!CLif 

8.8 OTHER EQUATIONS STUDIED 

Ahhougli we have been able to give a complete presentation of the gen- 
eral theory of the solutions to seCond-order linear equations about regular sin- 
gular points, apart from relatively trivial cases, only the solutions to those 
equations which can be transformed into the hypergeometric equations of 
Gauss and of Kummer have been exhaustively studied. The equations of 
Lame and Mathieu have also been studied, but only a small amount of knowl- 
edge of the functions defined by these equations has been obtained. The 
Mathieu equation is 

d^w , , , . 

{a + fr cos^r)M;==0 

where a and k are parameters, and the Lame equation is 
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'd^'^ [Tj + n(n+ l)m5n^(2|/n)]u;=0 

where $n{z\m) is the sine amplitude elliptic function of modulus m, and tj, n, 
and m are parameters. When n = 2, its solutions can be expressed in terms of 
elliptic functions. For more information about these equations, the reader is 
referred to reference 3. An extremely complete discussion of Mathieu's equa- 
tion with many applications is given in reference 30. 

AU the equations which have been discussed in the last two chapters can 
be derived from a single equation with six distinct regular singular points (with 
the characteristic exponents at each singular point differing by 1/2) by allowing 
these singular points to coalesce. The coalescence of any two such points is a 
regular singular point whose exponents differ by an arbitrary amount. The 
coalescence of three or more such points will result in an irregular singular 
point. The reader is referred to reference 3» chapter 20, for a more detailed 
study of these matters. 
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Solutions Near Irregular Singular Points: 
Asymptotic Expansions 

9.1 GENERAL CHARACTER OF SOLUTIONS 

Let 2o be an isolated singular point of the differential equation 

^+pW f +,(r).=0 (9-1) 

We have shown in chapter 6 that it is always possible to construct a funda- 
mental set of solutions to this equation on a punctured circular region about 
2;^ whenever Zo is a regular singular point. And these solutions can be expressed 
^in terms of certain convergent power series whose coefficients can be calculated 
successively. This occurs because the functions f\ {z) and ft{z) in the canonical 
basis (6-20) can have, at most, poles at Zo. However, this will not be the case 
when the point zq is an irregular singular point of equation (9-1) since at least 
one of the two functions f\{z) and f2{z) will then have an essential singularity 
at Zq. This ftinction will therefore have a series expansion about zo of the form 
(6-21) in which infinitely many negative powers of z — zo are present. And the 
coefficients of this series are determined by an infinite set of equations which 
cannot be solved recursively. For this reason we do not have a convenient 
method of finding the corresponding solution. In addition, the characteristic 
exponents 2^re determined by a transcendental equation (which usually cannot 
be solved explicitly) instead of by an algebraic equation. Finally, the series 
once found are usually slowly convergent. 
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9.2 FORMAL POWER SERIES 

Even if zo is an irregular singular point, it may still happen that the function 
fi{z) in the canonical basis (6-20) has, at most, a pole at zo, in which case it 
would still be possible to recursively construct ^ one solution about this point. 
And this solution would be of the form^ 

m;=(2-zo)^/(z) (9-2) 

where /(z) is analytic in a neighborhood of zov and therefore has a convergent 
power series expansion 

/U)= 5 an{z-z^Y (9-3) 

about Zo. We assume, without loss of generality, that the exponent p is adjusted 
to make ao 5^ 0 and therefore to make 

/(2o)7^0 (9-4) 

A second solution could then be found, at least in principle, from equation 
(6-63). 

When p{z) has an essential singularity at zo, equation (9~1) can possess 
a solution of the form (9-2) only when q[z) is equal to zero or has an essential 
singularity at zo. But suppose that p(z) has a pole at zo, say of order m. Thus, 

p(2)=(2-2o)-'"P(2) (9-5) 

where P(z) is analytic at z = zo. Now if equation (9-1) possesses a regular solu- 
tion of the form (9-2), this solution together with (9-5) can be substituted into 
equation (9-1) to obtain 



^ If it were the function ft{z) which had the pole at zo and the function j\{z) which had the essential singularity, 
then either we could (when change the notation so that the function /i(z) had the pole al zo or (when a 0) the 

solution voi would depend upon /](z) (through w\{z)) and could therefore not be constructed recursively^ 

^ Recall (ch. 6) that a solution of this type is called a regular solution. 
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''^-^ fiz) z-zof{z) (z-zoV 

And since /(zo) ^ 0, it follows that the functions /7/> /7/. and P are analytic 
at 2 = Co. 

First, suppose that m is either zero or 1. Then equation (9-6) shows that 
q(z) has, at most, a pole of order two. We therefore conclude that when p{z) 
has, at most, a simple pole at zo, equation (9-1) will possess a regular solution 
of the form (9^2) if, and only if, zo is a regular singular point. 

Now, suppose that m > 1. Then equation (9-^6) shows that ^z) has, at most, 
a i><)le of order m + 1. Hence, we conclude that when p(z) has a pole of order 
m > \ sx\ a point zo, equation (9-1) can possess a regular solution about this 
jK)int onjy \{q{z) has, at most, a pole of order m+ 1 at zo. 

The corresponding result for the case where the point zo is at oo can be 
obtained in the usual way by applying these results at the origin of the ^-plane 
to the coefficients of the transformed equation given by equations (6-28) and 
(6-29). This leads to the conclusion that if p(z) has a pole of order^ m 5^ 0 
about z==^, equation (9-1) possesses a solution about this point of the form 



V* £ZL 

only if the highest power of z which occurs in the Laurent series expansion of 
q(z) about z = ^ is m ~ 1. 

Now suppose that zo is a finite point, p(z) has a pole of order m at zo, and 
equation (9-1) possesses a solution of the form (9-2) about zo. Then, g(z) must 
be of the form 

g(z)-(z~Zo)-"-'<3(z) (9-7) 



** Ktrall that we say that a funrtion has a pole of order zero at a point if it is analytic at that |>oint. 
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where Q{z) is analytic at 2=zo. This function Q{z) and the function P{z) 
which appears in the representation (9-5) of p{z) can be expanded about zo 
in the convergent power series 



n=0 



(9-8) 



where po ^ 0. 

We can now proceed much as we did in chapter 6 for the case of a regular 
singular point by substituting equations (9-2), (9-3), (9-5), (9-7), and (9-8) 
with m > 1 into equation (9-1) and then collecting the coefficiejnts of like 
powers of z — zo. When this procedure is carried out, we find first that the 
indicial equation is not quadratic (as in the case of a regular singular point) 
but that it is an equation of the first degree which is 



ppo + qo = 0 (9-9) 

This is consistent with the fact that, at an irregular singular point, at most 
one solution of the form (9-2) can occur. 

Next, the coefficients of the series (9-3) can still be calculated recursively, 
but the resulting series will now either terminate after a finite number of terms 
or else it will diverge for all jz — 2o| > 0 (ref* ? p. 421). Thus, a regular solution 
will only exist in the exceptional case when the series (9-3) contains a finite 
number of terms. 

For example, the equation 

has an irregular singular point at z = 0. And it has a series solution about this 
point given by 
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which terminates after two terms. 

Even though it is possible to calculate as many terms as desired when the 
series does not terminate, the solution obtained in this manner will not have 
any meaning in the usual sense since the series does not converge. This should 
not be taken to mean, however, that this ''formal" solution is not useful. 

9.3 ASYMPTOTIC CHARACTER OF SOLUTIONS 

In order to introduce the concepts which allow the formal solutions 
obtained in the preceding section to be utilized, it is convenient to consider 
an example given by Euler in 1754. Thus, the differential equation 

+ u;' + 1 = 0 (9-10) 

has an irregular singular point at the origin and a regular singular point at 
infinity. Since the order of the pole of the coefficient of i*; at 2 = 0 does not 
exceed the order of the pole of the coefficient oiw' at 2 = 0 by more than 1, we 
know that equation (9-10) possesses one (and only one) formal solution about 
2 = 0 of the form 

m; = 2^ J a„2" (9-11) 

We can therefore proceed just as in the case of a regular singular point and 
substitute this expansion into equation (9-10), shift the indices to the lowest 
one present, and coUect terms to obtain 

J (ri + p)2a„-i2»+^-i + 2 + p)anz"+^-i = 0 

Then by equating the coefficients of the various powers of z to zero, we find 
that since ao 7^ 0 

P = 0 (9-12) 
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and 

(n + p)2a„^x = -(n + p)an for n = 1, 2, 3, . . . (9-13) 



The indicial equation (9-12) is consistent with the general indicial equation ~ 
(9-9) since, in this case, go = 0. When equation (9-12) is substituted into the 
recurrence relation (9-13), we obtain 

aR = — nan-i for n= 1,2,3,. . . (9-14) 
And by proceeding in the usual way, we conclude from this, that 

an = (— l)"n!ao 
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Finally, substituting this, together with equation (9-12), into equation (9-II) 
shows that equation (9-10) possesses the formal solution 



w;- 2 (-l)«n!2« (9-15) 

A simple application of the ratio test, however, shows that this series 
diverges for all z # 0. Hence, as we have already indicated in the general case, 
equation (9-15) is not a regular solution. However, we might anticipate that, 
since equation (9-15) was determined in a formal manner by the differential 
equation, it might still, in some sense, represent a solution to that differential 
equation* 

In order to see what this is, note that equations (5-29) and (5-36) show that 



e-H^dt (9-16) 

0 
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However, when this is substituted into equation (9-15), we find that 



/•X 

m; = V I e-'(-l)"znf"<ff 



And again, proceeding formally we interchange the order of summation and 
integration to obtain 



^= \ S {-zt)"dt 
Finally, summing the geometric series shows that 



Now this integral converges uniformly for all z in any region R bounded 
away from the negative real axis. In fact, differentiating with respect to z and 
interchanging the order of integration and differentiation shows that 



This means that for any positive number €, no matter how small, there exists a positive number T(e) which 
depends on c but not on z such that f [e-'/(l +2«)]rf« < « for all t S T{e) and all z in R. 
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But since this integral converges uniformly for all values of z in any region 
bounded away from the negative real axis (fig. 9-1), we can conclude that the 
derivative exists and that interchanging the order of integration and differentia- 
tion was in fact justified, provided z is not on the negative real axis (ref. 31). 

Hence, [€~^I{1 + zt)]dt is an analytic function of z everywhere in the z- 

Jo 

plane cut along the negative real axis and is therefore infinitely differentiable 
in this region. 

Upon multiplying equation (9-17) by z and equation (9-18) by z^ and 
then adding the result, we get 

Jo (l + Zt) Jo 

And after integration by parts, this becomes 
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l + zt\o Jo l+zt 
which shows that w satisfies the equation 

z^w' + {z+l)w^l 

provided z is not on the negative real axis. Since w is infinitely differentiable, 
we can certainly differentiate this equation with respect to z. But when this is 
done we obtain equation (9-10). Thus, the function w given by equation 
(9-17) provides a perfectly valid solution to equation (9-10). This solution 
was obtained by formally summing the divergent series (9-15), which was, in 
turn, obtained by formally solving equation (9-10). It is, therefore, natural to 
ask in which sense the divergent series (9-15) represents the integral (9-17) 
and, therefore, as a consequence, in what sense it represents a solution to 
equation (9-10). To answer this question, let 

m 

Sm{z)=^ (-l)»n!z« (9-19) 

be the /nth partial sum of the series (9-15). Now from elementary algebra, we 
know that the sum of the finite geometric series is 

m 1 r-m + l 

which becomes, upon setting r= — zt, 



1 ( — \ m+l m 

TT^=TTir+.2(-i)"M" 



n=0 



But, upon multiplying both sides by and integrating between 0 and oo, we 
find that 



T^dt^l t(-l)«(zO«e~^c/^+/?m(z) 
Jo 1 + z^ Jo 
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where we have put 

/?,„(2)= ez)-+i —^d^ (9-20) 

And since it is always legitimate to interchange the order of integration and 
summation for a finite sum, this becomes 

Hence, substituting in equations (9-16) and (9-19) shows that 

Jo - Sm{z) = Rmiz) (9-21) 

Now since 

\l+zt\ = \l + xt+iyt\ = V {I + xt)^ + y'f^ 

it follows that 

|1 + zt\ 22 V(l + xt)'^ =\l+xt\^l {oi^z--=x>0 
And for ^ z = x ^ 0 y/e find that 



|1 + zt\ y/{xty+ {yty ={{l + xt^ixty + ft^iil + xt)'^ + W\ + (y«)^}»/2 

^ yffiii + xtY + {xtyq ^ \yt\ 

Hence 

ll + ^^I^TTH W. s =-T7= w[^* =TT-|sin<^| for ^z=:«<0 

' ' y2 V(a:02+ (y«)2 V2 V2 ' ^' 
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where <f> is the argument of 2. We have therefore shown that 

j^^l for^.z=*0 (9-22) 

and 

^ V2 Icosec (f>\ for z^0;\(f>\<7r (9-23) 
It now follows from equations (9-20) and (9-22) that when M z^O 

^ |-|m+l £ 

'''' Jo I l + zt 

And equations (9-16) and (9-21) therefore show that 

\w,iz)-Smiz)\^\z\"' + 'im+l)l for^2>0 (9-24) 

where 

m{z) = 1^ iT^jrft (9-25) 

is the solution to equation (9-10). In a similar way, it follows from equation 
(9-23) that 

\wi(z)-Sm{z)\^ \/2| coseC(^l |2|"' + >(m+l) ! forM 2<O;|0|<77- 

(9-26) 
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Thus, in view of equations (9-15) and (9-19), the inequalities^ (9-24) 
and (9-26) show that, provided the argument of z, is smaller in absolute 
value than tt, the error incurred by computing the solution Wi(z) by means of 
the divergent series (9-15) goes to zero rapidly as z— ^ 0. Thus, for any fixed m, 
any desired accuracy can be obtained by taking |z| sufficiently near zero. In 
particular, the inequality (9-24) shows that, provided M z > 0, the error is 
never greater in magnitude than the first term omitted in the series. 

Now recall that a series ^ an is said to converge to a sum A if its partial 

rn 

sums an satisfy the relation 

lim \A — tm\=^0 

The series (9-15) certainly does not converge to the solution wi{z) since 

lim |u;i(z) -Srniz) 1 ^0 (9-27) 

But this series is said to be an asymptotic expansion (which will be defined 
subsequently) of Wi{z'p since, as can be seen from equations (9-24) and 
(9-26), it has the property that 

li^ m{z)-Smiz) ^Q for|<#,|^7r+€ (9-28) 

for any e > 0. 

9.4 ASYMPTOTIC EXPANSIONS 

Roughly speaking, equation (9-28) shows that the difference between 
the solution Wi(z) and the mth partial sum Smiz) of the series (9—15) approaches 
zero more rapidly than z^ as z->0. Comparing the definition of convergence 
with the corresponding condition (9-28) for a series to be asymptotic, shows 
that the essential difference between these two concepts can be sWed in the 
following way: If the series is convergent to m;i(z), thenz is held fixed and the 
difference wi{z) — Sm{z) approaches zero as m approaches infinity. If the 
series is asymptotic to Wi{z) , then the number m of terms is held fixed and the 
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difference wi{z)^Sm{z) approaches zero (at a specified rale) as 2 approaches 
some fixed value, say 20. 

There is no reason why a {^ven series cannot be both asymptotic and con- 

ae 

vergent at the same time. For example, the geometric series ^ 2" is convergent 

to 1/(1 —2) for \z\ < 1 and it is also an asymptotic expansion of this function 
as 2 — ► 0. 

When a series is convergent as well as asymptotic, the approximation 
can usually be improved at fixed 2 by taking more and more terms in the par- 
tial sum. However, it happens more frequently that an asymptotic series is 
divergent.^ When this is the case, there is some limiting value to the accuracy 
of the approximation which can be obtained at each fixed value of 2. This limit- 
ing value is attained when the optimal number of terms is retained in the expan- 
sion. Thus, for the expansion (9-15) with z > 0, the right side of the inequality 
(9-24) is a, minimum when m ^ \z\-^. For this value of m, Sm{z) will provide 
the best approximation to Wi{z). 

The theory of asymptclic expansion was initiated by Stieltjes and by Poin- 
care at the end of the nineteenth century* Before ^ving the general definition 
of an asymptotic expansion!, it is convenient to introduce the concept of order. 
Thus, if <^ and i// are complex functions of z, we write 

<^ = 0(i//) as z— > 2o 

if there exists a finite constant A such that 

And we write 

0^o(i/f) as z— ^ 2o 

if 

lim^=0 



^''Usually in this caree the terms nf the series first decrease rapidly (the more rapidly the closer the independent 
variable is to its lin;iting value) but eventualiy start to increase again. 

263 



ERLC 



DIFFERENTIAL EQUATIONS 

The symbols O and o are called order symbols, and in both cases we say that 
4> is of order ^. Thus, 

z^-O(z^) as 00 

2^ = 0(Z^) as 2-> 00 

^ = 0{^^ + 3r^) as 2-^ 00 

but 



Also 



but 



and, for 2 > 0, 



z^^ o(4z4 + 3z3) as2-^ oo 



z^ = o(z^) as 2—^ 0 



2^7^o(r^) as2->0 



e-'^ = o{z^) as — ^ 00 



for any constant a. 

If/(;;) is an analytic function which has a pole of order m at 20, then 

/(2) = 0((2-2o)~'") and f(z) 9^ o({z-zo)-"^) as2->2o 



It is cominon practice to denote any sequence, say ai, a2, aa, . . by 
{aj}. A sequence of functions {^jiz)} is said to be an asymptotic sequence as 
2— ^2o if for each integer;, <f)j-^i = o{(f>j) as 2-^ 20. Thus, {(2 — 20)-'} is an asymp- 
fiotic sequence as 2—^20; {z^^} is as asymptotic sequence as2— ^ 00; and {e~-^*} is 
an asymptotic sequence as 2— > 00, provided 2 > 0. 



264 



ASYMPTOTIC EXPANSIONS 

Note that equation (9-28) can be written in terms of the order symbol o as 

u;i — Sm = o(2'") as2— > 0 

We are, therefore, led to the following definition: Let {(})j{z)} be an asymptotic 
sequence as Zo. Then the formal series 

^ aMz) (9-29) 

m 

with partial s^^ms SmU)= ^aj(f>j{z) is called an asymptotic series. The 

asymptotic oeries (9-29) is said to be an asymptotic expansion to m term^s 
of a function f{z) if 

/(z)-.Sm(z)=o(0m) as2->2o (9-30) 

and we write 

m 

If equation (9-30) holds for every positive integer /n, we simply say that 
equation (9-29) is an asymptotic expansion ot f{z) and we write 

/(z)- Yaj<f>j{z) 

Thus, in the preceding example, we have shown that 

This series is typical in that most asymptotic series encc mtered in practice 
involve powers or inverse powers of 2. Such series are called asymptotic power 
series. 

Once a particular asymptotic sequence has been specified, any given 
function will have only one asymptotic expansion in terms of this j>c^uence. 
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In this sense the asymptotic expansion is unique. However, two different 
functions may have the same asymptotic expansion. Thus, if 

X 

it is not hard to verify that 

n = 0 

for :5 > 0. 

It can be shown that \i f{z) ^^an^n{z) and ^(z) — ^bn^n{z)^ then 
+ ^2 {0Lan^^bnHn{z) 

for any complex constants a and /3. It is generally possible to integrate asymp- 
totic expansions term by term, but differentiation is not always permissible 
(ref.32). 

Asymptotic power series can be manipulated in much the same way as 
convergent power series. Let the function f{z) be a single-valued analytic 
function at every finite pointz with jz| > /?, If/(z) has the asymptotic expansion 

a; 

/(z) ^ ^ anz"'' as z-> 00 

and this expansion! is valid for all values of the argument of z, then /(z) must 
be bounded as z— Hence, it cannot possess a pole or an essential singu- 
larity at z=oo. Therefore, an analytic function cannot possess a single asymptotic 
expansion in inverse powers of z as z— >oo which is valid for all values of the 
argument of z unless it is analytic at infinity. Thus, asymptotic power series 
are frequently valid only over a given sector of the complex plane, and a 
different asymptotic representation must be used outside this sector. This 
is closely related to the so-called Stokes phenomenon which we shall encounter 
subsequently. ^ 

If a function /(z) is analytic at a point Zo and, therefore, possesses a con- 
vergent power series about zo, it is not hard to see that the series must also 
be an asymptotic expansion of/(z) asz— >zo (ref. 32, p. 22). 
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9.5 NORMAL SOLUTIONS 

Let zo be an irregular singular point of the equation 

w"+p{z)w' + q{z)w=0 (9-31) 

and suppose that, if zo is a finite point, 

p = 0 ( (2 - 20) -'^O and q = Oi{z-zo) '^^^'^) as z zo 

and that, if 20 = 0^, 

p = 0{2'") and g = 0(2^^-^^) as?-->oo 

where m and A: are integers. 

We have seen that, when k^m (and only in this case), it is always possible 
to construct a formal series solution Wi{z) of the form 

wx{z)=^ {z — z^y y aw(2 — 2o)" ifzoisfinite (9-32a) 

or of the form 

wx (2) =^2^2 a„2-« if 20^00 (9-32b) 

which satisfies the differential equation term by term. The coefficients of these 
expansions can be calculated recursively from the differential equation in 
much the same manner as those in the series solutions at regular singular 
points^ These expansions will, in general, be divergent. However, as we have 
seen by example they actually turn out to be asymptotic expansions of a true 
solution to equation (9-31) at the point 2—20. They will, therefore, be very 
useful for numerical computation of this solution for2 near 20. 

The series in equations (9-32a) and (9-32b) will not diverge only if they 
terminate after a finite number of terms, in which case these equations will 
represent regular solutions to the differential equation (9^31), A second solu- 



In fad. asymj)tj)tic expansU>ns are quite frequently more suitable for numerical nunputalion than convergent 
|)ower series since fewer terms are required to obtain a given accuracy. ^ • 
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tion at the point zo can then always be found from equation (6-63). Thus, except 
in the relatively rare case where m and the formal power series solution 
terminates, it is still necessary to find one or two solutions to equation (9-31) 
or at least the asymptotic expansion.^ of these solutions about the irregular 
singular point z = zo. To this end, we introduce into equation (9-31) the change 
of dependent variable 



where 



(9-33) 



9 

^ ojn(z — 2o)"" ifzo is finite 

2; CUnZ" ifZo==00 



(9-34) 



and the coefficients o)„ for n=l, 2, . . 5 are complex constants. Then 
equation (9-31) is transformed into the equation 



u'+ p+(z)u' + g+ (z)u = 0 (9-35) 

where 

p+(z)=p(z) + 2ft' (9-36) 

and 

g-^(z) = g(z)+p(z)ft' + ft"+ft'2 (9^37) 

Now if, when zo is finite, the terms in Cl(z) can be chosen to cancel out 
enough of the negative powers of z — zo which arise from p(z) and q{z) so that 
p+(z) has, at most, a simple pole and g'^(z) has, at most, a pole of order two at 
Zo, then zo will be a regular singular point of equation (9-35). Similar remarks, 
of course, apply when zo=oo. Jn either case, then, when this can be done, a 
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fundamental set of solutions can always be found by the methods of chapter 6; 
and equation (9-33) will then provide a fundamental set of solutions of equa- 
tion (9-31). But this usually cannot be done. More frequently, it is only pos- 
sible to adjust the coefficients in ft so that the resulting equation ^(9-35) will 
possess a formal solution either of the form (9-32a) (when zo is finite) or of the 
form (9-32b) (when Zo is infinite). Then equation (9-31) will have a formal solu- 
tion either of the form 

ii;(z) = e"<^)(z-zo)^ 2 ^niz-zo)"" ifzo is finite (9-38a) 

n=0 

or of the form 

7(;(z) = e"(^)z^ 2 ^n-^"" ifzo=^<» (9-38b) 

n=0 

These formal solutions, called normal solutions^ either will terminate or they 
will diverge in v/hich case th ey will be asymptotic expansions. 

Before discussing this in more detail, it is convenient to introduce the 
following definition: If the coefficients p(z) and q{z) of the differential equation 

w"+p{z)w' + q{z)w==^0 (9-39) 

have, at most, poles at zo, the equation is said to be of finite rank at zo. If zo is 
a finite point and equation (9-39) is of finite rank at Zo, the smallest number r 
such that both 

p=0((z-zo)-^'*^*0 and 9=0((z-zo)-2(r+i)) asz^zo 

is called the rank of equation (9-39) at zo. The rank of equation (9-39) at 
z= CO is defined to be the smallest number r such that 

p = 0(z'*-») and q 0 {z^^^ - asz-^« 

provided the equation is of finite rank at If the equation has a regular 
singular point at Zo, it is said to be of rank zero. 
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■ 1 

For example, since the coefficients of the equation 



zw"+w' + w = 6 



(9-40) 



satisfy the conditions 



9=0(2-0 



as z ^ 



we see that this equation is of rank 1/2 at z = oo. 

Now suppose that equation (9~31) is of rank r > 0 at the point zo. In order 
that equation (9-35) possess a formal solution of the form (9-32a) when zo is a 
finite point, it is necessary that the highest negative power of z— zo in g"*" exceed 
the highest negative power in p+ by no more than 1. And if equation (9-35) is 
to possess a formal solution of the form (9- 32b) when zo==oo, it is necessary 
that the highest power of z in g"*" be less than the highest power of z in p'^. 
Suppose that zo = ^. An examination of the expression obtained by substituting 
equation (9-34) into equations (9-36) and (9-37) shows that q'^ will always 
contain higher powers of z than p+ unkss the numbers (On and s in equation 
(9-34) can be chosen to cancel out the coefficients of those powers of z in q'^ 
which are larger than, or equal to, those in p^. This can be done only if the rank 
r of equation (9-31) is an integer. And the maximum value of s necessary to 
accomplish this will then always be less than, or equal to, r. The same con- 
clusion applies when zo is finite. It is usually possible to choose the numbers 
a)n and s so that the cancellation is accomplished in more than one way. In 
this case, we obtain two solutions to equation (9-31). 

Thus, equation {9-31) will possess formal solutions either of the form 
{9-38a) or the form (9-386) at the point zo only if the rank r of this equation at 
zo is an integer. The function ft(z) is then given by equation {9-34) with s^r. 

Since equation (9-40) is of rank 1/2 at z=oo, it does not possess a normal 
solution at this point. 

As an example of an equation which does possess such a solution at z=oo, 
consider the equation 



w" + q{z)w==0 



(9-41) 
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with 



q{z) = £ 9„z-« (9-42) 

and 

go 9^0 (9-43) 

We see in view of condition (9-43) that equation (9-41) is of rank 1 at 2=00. 
Hence, we make the change of dependent variable 

w=e^u (9-44) 

where, since s ^ r= 1, 



n=a),2 (9-45) 

And upon substituting equations ^9-44) and (9-45) into equation (9-41) we 
find that 

u"+pHz)u' + q^{z)u^O (9-46 ) 

X 

where p^{z)'=^2(0i and q'^(z)='0)j + qo+ ^ qnZ^^. The highest power of 2 

n= 1 

which occurs in both p+ and q'' is zero. Hence, the highest power of 2 which 
occurs in 9+ can be made less than the highest power which occurs in by 
choosing o>i to be a root of the equation 

^1 + 90 = 0 

But the two roots of this equation are a)i,i = iq}l^ and wi,2 =— i^J/^. And each of 
these roots leads to a different form of equation (9-46). Thus, we obtain the 
two equations 
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(9-46a) 



u:~2iqy'u',+ q{z)u2 = 0 (9-46b) 

X 

where g(z) = ^ QnZ'^. But we know that these equations possess formal 



. 71 = 1 



solutions of the form 

w,=2^i 2 a„z-» (9-47a) 



71 = 0 

and 



^2=2^-^ £ ^nZ"'^ (9-47b) 
n = 0 

where pi and p2 are each solutions of linear indicial equations and the coeffi- 
cients dn and 6;, can be calculated successively froim a recurrence relation of 
the usual type. 

Thus, for example, upon substituting equation (9— 47a) inio equation 
(9-46a), shifting the indices, and collecting coefficients of like powers of 
z in the usual way, we obtain 



/I = 2 



^ (pi-n + 2) (pi-n + l)a„>2Z~" 

+ Jz-" 2iqyHpi- n+l)an-i+ ^ J = « 



n = 1 



And after equating to zero the coefficients of like powers of z, we find that for 
n = l (since Co 9^ 0) 



2igrpi + 9i = 0 (9-48) 



272 



ASYMPTOTIC EXPANSIONS 



and 



[2iqy^{pi-n+l) + qi]an^i='-{pi-n + 2) (pi + l)a„-2 



~ S Qf^^n^k for n = 2, 3, 

/C=2 



(9-49) 



Equation (9-48) is the usual linear indicia! equation. And substituting this 
mto the recurrence relation (9-49) shows that 

-Qiqf' (n - l)a„ - 1 = [gi + 2iq]l'' {n - 2)] [q, + 2iq^ (n - 1 ) [a„ 



-4^0 2 Qkan-k forn = 2,3, . . . (9-49a) 

This recurrence relation will either terminate or else it will determine the 
an so that the series (9— 47a) diverges. 

In any event, the two formal solutions (9-47a) and (9-47b) will now 
provide, through equations (9-44) and (9-45), two normal solutions to 
equation (9-41), say wi and w^^ which are given by 



n=0 

00 



n=0 



(9-50) 



Note that if condition (9—43) did not hold (i.e., if 90 = 0) but the condition 
Qi 7^ 0 did hold, then equation (9-41) would be of rank 1/2 at z=oo. In this 
case, it would not be possible to carry out the procedure just described. 
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9.6 SUBNORMAL SOLUTIONS 

We have seen that if equation (9-31) is of rank r with r > 0 at the point 
Zo, it will have a formal solution of the form (9-~38a) or (9-"38b) only if r is an 
integer. However, a change of independent variable of the type 



(2 -~ zo) if zo is finite 

1/^- ifzo=oo 



where k is a positive^ integer, will usually transform an equation of fractional 
rank into one ^whose rank is an integer. The formal solutions obtained by this 
procedure .^^re called subnormal solutions. 

Thus, we have shown that equation (9-41) in the preceding example has 
rank 1/2 at 00 when condition (9-~43) does not hold but the condition Qit^O does 
hold. That is, the equation 

tv''+qiz)w=0 (9-51) 

where 



qiz)=^f^qnz-^ (9-52) 

and 



qiT^O (9-53) 

has rank 1/2 at 2=00 and, therefore, does not possess a normal solution at this 
point. However, upon making the change of variable ^=2^/^, equation (9-51) 
becomes 



d^w 1 dw ^ 



(9-54) 
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where 

<2U)=4|; S-^t"-^>9« (9-55) 

And since this equation is of rank i at ^=00, we introduce the change of 
variable 

w^e'^iki (9-56) 

to obtain the equation 



^ + /'ia)^+<?iU)"=0 (9-57) 



where 



<?.(0=-T+a>H4g. + 4|; ) 

Then by putting 

a)? + 4g, = 0 (9-58) 

we find that the highest power of ^ which occurs in is less than the highest 
power which occurs in Pi. And, as in the preceding'example, corresponding 
to the iwo roots ±i2q\^^^ of equation (9-58) we obtain the following two equa- 
tions from equation (9-56): 



275 



ERIC 



DIFFERENTIAL EQUATION? 



00 

But we know that these equations possess the formal solutions ai = ^ an^*~" 
and U2 = C^- 2 whose coefficients can be calculated recursively in the 

usual way. And therefore equation (9~-51) possesses the two subnormal solutions 



9 7 NATURE OF RIGOROUS PROOFS 

The formal solutions obtained in the preceding section are asymptotic 
expansions of certain solutions to the differential equations. One method 
for actually proving this was developed by G. Birkhoff. In this method the 
leading terms of the partial sums of each formal solution are used to con- 
struct a homogeneous differential equation whose solution is known and which 
in a certain sense is close to the given equation when z is near^^ 20. This equation 
is then used to construct a singular integral equation whose solution also satis- 
fies the given differential equation. It is then proved th?it the solution to this 
integral equation possesses an asymptotic expansion which coincides with 
the formal solution obtained by the methods discussed previously. For a de- 
tailed discussion of this method, in which equation (9-41) is treated to illustrate 
the general principles, the reader is referred to reference 32. 




9.8 CONNECTION OF SOLUTIONS: STOKES PHENOiwRoN 



In the preceding examples, we have shown how to obtain the asymptotic 
expansions as 2 of two solutions to a differential equation of the type 



®* Without loss of t?enerality. tSic point 20 (about which the solutions are obtained) is taken as » 
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(^-41). The problem frequently arises of connecting these asymptotic expan- 
sions with an expression for some given solution to the differential equation 
which is valid for small values of z. We know, in general, that the asymptotic 
expansion of any given solution w to equation (9-41) can be expressed as a 
linear combination of the two asymptotic solutions (9-50). However, it usually 
turns out that the particular linear combination of these two asymptotic solu- 
tions used to represent the asymptotic expansion of the given solution w must 
be changed as the variable z crosses certain "critical rays'' in going from one 
sector of the complex plane to another. This is the Stokes phenomenon which we 
have mentioned previously. 

For example, the change of variable 



W 



(9-61) 



transforms BessePs equation 



zW'+zW + {z^ - p^)W= 0 



(9-62) 



into the equation 




(9-63) 



which has the form of equation (9-41) with the coefficients in equation (9-42) 
given by 



^0= 1 



-1 2 
92 = 4-p' 



and 



ign = 0 for 71 = 3,4,5, 



(9-64) 



Such as a power series expansion. 



277 



ERIC 



DIFFERENTIAL EQUATIONS 

And if we choose the arbitrary constants ao and 6c, respectively, to be 

(9-65) 



= I ± ) I e-'t<P"/2)+(7r/4)] 



=(D' 

it is easy to show lhat the formal solutions (9-50) become in this case 

2^2 = y-j ^ e-'t^-<'>'^/2)-(7r/4)] £ a„(.i)"z" (9-67) 



where 



Hence, the asymptotic expansion of any given solution W of equation 
(9-62) can be expressed as a linear combination 



of the functions (9-66) and (9-67) multiplied by z^*^^. Let us choose the solution 
W{z) to be the Bessel function of the first kind Jp(2). Then equation (8-37) 
shows that for — tt < arg z < tt, Ci == C2 = 1 and 

Jp(z) - z-}J''wt{z) + z-'l^W2(z) -7r<argz<7r (9-68) 

This representation does not apply along the critical ray arg z = tt, that is, 
along the negative real axis. To find an asymptotic expansion which is valid 
in a region which includes the negative real axis, put 
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z = e'^'zi (9-69) 

Then since arg 2 = 7r-harg Zi, arg z varies beU^^en 0 and 27r as arg zi varies 
between — rr and tt. And it follows from the definition (8-27) of the Bessel 
function that 

Jp{z) =yp(e^*2i) = e^^^Jp ) for |arg zi\ < n 

But arg Z\ is in the range where Jp has the asymptotic representation (9-68). 
Hence, 

Jp{z) - e'^'Pzi'^'^wiizi) + e^'>2r'^^M^2Ui) for |arg zi\ < n 
And since equations (9-66) and (9-67) show that 

wiizi) = e-^t^'^+^^'^^WzU) W2{zi) = e^^'^+<'^/2>lu;i(2) 

it follows that 

Jp{z) - z-'f^W2{z)-e^''if'z-'l-Wi{z) for 0 < arg 2 < 27r (9-70) 

Comparinie; equations (9-68) and (9-70) shows that different linear com- 
binations of wi{z) and tvziz) must be usM to represent the asymptotic expan- 
sion of Jp{z) in the sectors — tt < arg rr and 0 < arg z < 2tt. And, equa- 
tions (9-66), (9-67), and (9-70) show that 

to one term, for 0 < arg 2 < 27r (9-71) 

Since in each region of the complex plane one of tramunctions, wi{z) and 
W2{z)^ will be exponentially small compared with th^lmer, the expansions 
(9-69) aird (9-70) will be equal to one another, with exponentially small error, 
in every region where they are both defined. 
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CHAPTER 10 



Expansions in Small and Large Parameters: 
Sinpar Perturbations 

Many of the differential equations encountered in practice contain param- 
eters. Although it frequently happens that we cannot^ find the exact soluti<>ns 
to these equations, the behavior of these solutions for large or small values of 
the parameters is often physically important. In such cases we are content to 
find asymptotic representations of the solutions which are valid for these 
limiting values of the parameters. A number of techniques for obtaining such 
expansions are given in this chapter. Since no formal theory has been developed 
for many of these techniques, the approach of this chapter is necessarily 
heuristic and the material is frequently presented by means of examples. 
On the other hand, the ideas developed herein are quite general; and they 
apply not only to ordinary differential equations, but also to partial differential 
equations, integral equations, and even difference equations. 

10.1 NONSINGULAR EXPANSIONS OF SOLUTIONS 

The general second-order homogeneous linear equation containing a 
large parameter X is of the form 



0 + p(;f, \) ^ + q(x. X)y-0 (10-1) 



We suppose that p{x, k) and qix, k) have (at least formal) power series ex- 
pansions in \. If these expansions contain only nonpositive powers of \, say 
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pU, X)= I; p„(jc)\-« (10-2) 



n=0 



q(x,\)--2qn(x)k-- (10-3) 



n=0 



then the solutions to equation (10-1) will have a formal power series expansion 
of the form 



y(x)='2yn(x)k-n (10-4) 

where the functions ynix) are determined by substituting the expansion 
(10-4) into equation (10-1) and equating to zero the coefficients of like powers 
of X to obtain 



^ + Po(^)^+9o(^)yn= -'|;[pn-.(^)^ + C?n-.(^)y.] 



forn = 0, 1,2, . (10-5) 

and the sum on the right is omitted for n = 0. These equations can, at least in 
principle, be solved successively for the coefficients yn. Jtf the series (10-2) 
and (10-3) converge, it can be shown (ret 4, p. 126, ex. 6) that the series (10-4) 
will also converge. In any case, the formal series (10-4) will usually be an 
asymptotic expansion. 

However, if the formal power series expansion for either p(x, X) or q(x, X) 
involves any positive powers of X, the expansion of the solution in powers of 
X will, in general, involve infinitely many positive and negative powers of X; 
and it will not be possible to solve for the coefficients successively. Neverthe- 
less, it is still possible in certain instances to obtain formal solutions whose 
terms can be calculated successively by using a technique analogous to the 
procedure used in the preceding chapter to obtain solutions at irregular singular 
points. These solutions will not, in general, be convergent series; but they 
will be asymptotic expansions. Thus, consider the equation 

g+p(x, \) ^+qix, \)y=0 (10-6) 
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where 

P(^,X)= ip«U)X'-" (10-7) 



q(x,k)=2q„{x)k-'>^-" (10-8) 



n=0 



A: is a positive integer, and po(x) and qo{x) are not both identically zero. Then 
it can be shown by direct substitution that equation (10-6) will possess two 
formal solutions of the form 



M = 0 



where 

ft(:t) = V (On{x)\^-^ (10-10) 

n = 0 



The coefficents yn and con can be calculated by solving successively the set 
of ordinary differential equations which is obtained by substituting the assumed 
solution (10-9) into equation (10-6) and equating to zero the coefficients of 
like powers of X. 

In order to illustrate these ideas, consider the differential equation 

0+[A^9o(:t) +92(x)] v = 0 (10-11) 

which was first discussed by LiouviUe in his classical investigations of the 
Sturm-Liouville problems. 

Since in this case A:=l, the differential equation wiU possess formal 
solutions of the form 

^ y=e-o(^u I; y„(x)X-« (10-12) 

n=:0 
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After substituting this into equation (10-11) and collecting terms, we find that 
But upon shifting indices, this becomes 

n«2 n=l 

+ y (9o + (ui=')y„X2-« = 0 

And by equating the coefficients of the like powers of X to zero, we get 

(9o + wi2)yo = 0 forn = 0 (10-13) 
2o)'oyi+cd'iyo+ (qo + (o'o^)yi=0 for«=l (10-14) 

and 

yn-2 + 92yn-2 + 2c«>oyi_i + woVn-i + (qo + (Oo^)yn = 0 for n = 2, 3, . . . 

(10-15) 

In order to avoid the trivial solution y=0, we must require that yo^^O. 
Hence, equation (10-13) becomes 

9o + <Uo^ = 0 (10-16) 

When this is used in equations (10-14) and (10-15), we obtain 

2a);y;+a>> = 0 ' \ 
2woy^_, + (OoYn-i = ~ yl.2 - Q2yn-2 for « = 2, 3, . . . jl 
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In the case of the differential equation (10-1) we had to solve the set of 
second-order differential equations (10-5) to determine the coefficients yn\ 
whereas, in this case it is only necessary to solve a set of first-order equations.^^ 
Since 0 equation (10-16) will have two distinct solutions, say coo, i and 
Wo. 2 , given by 




(10-18) 



a}o.2 = - J V-go dx (10-19) 

Corresponding to each of these roots, we will obtain a different set of 
equations from equations (10-17) and, therefore, equation (10-12) will yield 
two different formal solutions to equation (10-11). It is proved in reference 
32 (p- 83), that these two formal solutions are actually asymptotic expansions 
of two linearly independent solutions lo equation (10-11) in any finite interval 
a < jc < 6 in which go does not take on the value zero. The first equation 
(10-17) will yield the same equation for both of the roots (10-18) and (10-19). 
Thus, when equation (10-16) is substituted into the first equation (10-17), 
we obtain the separable equation 



which is easily solved to obtain 

yo= constant X 9o ^'^^ (10-20) 

Equations (10-18) to (10-20) can now be substituted into equation (10-12) 
to show that the general solution of equation (10-11) in any interval a<x<h 
where qQ{x) 0 has the asymptotic expansion 

y-Ciq^^'^e'i'^'^''^ ^C^q^'^'^e'l'^'' to o^e term (10-21) 



This situation is analogous to the reduction of the indicial e(juatj/>n from a quadratic to a linear equation in 
going from a regular singtilar point to an irregular sin;pcular point 
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where Ci and C2 are arbitrary constants. Thus, qo{x) must be either strictly 
positive or else strictly negative for all a < jc < 6. If 90 is strictly negative, the 
constants of equation (10-21) can be redefined slightly to obtain 

to one term, for qo{x) < 0 (10-22) 

And if qoix) is strictly positive for al\a<x<bj the constants can be redefined 
to obtain 

y-Ciqz'^^ sin | V^rfx) + Cz^o | V^odx'j 

to one term, for qoix) > 0 (10-23) 

Notice that the asymptotic solution (10-22) has a monotonic behavior, 
while the asymptotic solution (10-23) has an oscillatory behavior. 

10.2 TRANSITiON POINTS 

Now let us consider the case where qo{x) is equal to zero at a single point, 
say JCo, in the interval a<x<b. And suppose, in addition, that qo{x) and 
q2{x) are analytic at jco. Then qo{x) and q2{x) must have the expiinsions 

qo{x)=qo,i{x—xo) + qo,2{x-'Xoy+* . . (10-24) 

q2{x) = q2,o'^rq2,i{x—Xo) + . . . (10-25) 

about the point x^x^^ and we shall require for definiteness that qo.i^O. 

Thus, the point xo is an ordinary point of the differential equation (10-11). 
Every solution to this equation must, therefore, be analytic at Jto. But in view 
of equation (10-24), equation (10-21) implies that 

y==0((jc~jco)-*'') as x xo (10-26) 

Hence, the asymptotic expansion (10-21) cannot represent an analytic func- 
tion in a neighborhood of xo and, therefore, it certainly cannot be the asymp 
totic expansion of any solution to equation (10-11) in the neighborho(v'' 
this point. 
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However, for any positive number 8 (no matter how small), equation 
(10-21) provides a valid asymptotic expansion, to one term,, of the general 
solution equation (10-11) both in the interval a < x < xq-- d and hi the 
interval Xo + d<x<b because qo{x) does not vanish in either of these 
intervals. Since equation (10-24) shows that qo{x) is not tangent to the 
X-axis at jcq, it must cross the axis at this point and must, therefore, he positive 
in one of the intervals. The solution to equation (10^11) will then have the 
asymptotic expansion (10-23) in this interval In the other interval, qo{x) will 
be negative and equation (10-11) will have the asymptotic solution (10-22). 
Thus, the asymptotic solution to equation (10-11) will have an oscillatory 
behavior on one side of xo and will have a monotonic behavior on the other side. 
The transition from one type of behavior to the other takes place in a small 
region centered at xo. The point Xo is, therefore^ called a transition point. 

When the second equation (10-17) with n = 2 is solved for yi{x) and 
equations (10-16) and (10-20) are substituted into the result, it is found 
from equations (10-24) and (10-25) that 

yi=0((:t-:to)"^'^) as x--> :to 

But equation (10-26) shov/s that yo is of order (x — Xo)"^*^^ as x-^xo. Hence, 
the second term in the expansion (10-12) will be approximately equal to the 
first term when 

\{x-Xo)-'^'\ -X-"|(x-Xo)-^/1 

that is, when the distance between x and Xo is approximately |jc — JCo| X"^^^. 

Thus, when the distance between x and xo is less than or ^J^al to the 
order of the terms of the expansion (10-12) will actually increase with increas- 
ing n. This shows that the asymptotic expansion breaks dov/n in a region of 
radius X'-^^^ about the point xo» It is, therefore, said to be a nonuniformly valid 
asymptotic expansion. 

In order to obtain an asymptotic expansion which is valid in this region, we 
rescale the independent variable so that it will be of order 1 therein. That is, 
we introduce the new independent variable 

^={x-Xo)\^!^ (10-27) 



*®*The term turning point is also used. This term arises from liit- application of cq. (10-11) *o classical and quan» 
turn mechanical wave reflection pit)blems. 
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into equations (10-11), (10-24), and (10-25) to get 



[ ^'''90 ( xfe )+ x^92 ) ] y== 0 (10-28) 

9<>(;5^) = 9o,i3;|j+go,2;j^+ . . . (10-29) 



and 



92('5^) = g2,o+g2.i;5|^+ • • • (10-30) 

Then upon substituting equations (10-29) and (10-30) into equation (10-28) 
and neglecting terms which are small for large values of X, we get 

^+9oa^^y=0 (10-31) 

The solution to this equation should be "close" to the true solution to equation 
(10-11) at least in the region 

|a;-A:o|<X-2/3 (10-32) 

or < 1. Hence, it should represent the first term of the asymptotic expan- 
sion of the solution to equation (10-11) in the region (10-32), 

The differential equation (10-31) is a form of Airy's equation (ref, 29, 
section 6.4) which can be transformed by the change of variable 

into the Bessel's equation 
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(see eq. (8-24)). Thus, the general solution to equation (10-31) is 




( 3 X»/3 D,e"J-m ( I y/^ii'" ) (10-33) 



where 0% and D2 are arbitrary constants and the normalization factor (ttX^'^/S)^'^ 
has been inserted for convenience. 

Let us now suppose, for deliniteness, that 



Then solution (10-22) will hold in the region a < x < xq-- 8 and the solution 
(10-23) will hold in the region xo+ 8 < x < where 8 is some arbitrarily 
small positive constant. The solution (10-33) holds in some region which is 
centered at xo and has a size at least of order X"^/^, Having found the pieces 
of the solution which apply in the three regions into which the interval a<x< b 
has been divided, it is now necessary to match up these pieces across the ad- 
jacent regions to form one continuous solution. These pieces of the solution 
contain altogether six arbitrary constants. Four of these will be determined by 
the matching requirement. The other two must remain arbitrary if we are 
to obtain an asymptotic expansion of the general solution to equation (10-11). 
In order to accomplish this matching, we suppose that the regions of validity 
of the various pieces of the solution can be extended in such a way that any 
two adjacent regions overlap one another. Thus, we assume there is an ''over- 
lap domain*^ (or intermediate region) in which both the expansions (10-22) 
and (10-33) are asymptotic expansions of the solution to equation (10-11) 
and that there is an overlap domain in which both the expansions (10-23) and 
(10-33) are asymptotic expansions of the solutions to equation (10-11) (see 



9o.i>0 



(10-34) 
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Region of applicability of solution 00-33), "inner region" 

f * . 

"Outer region", region of ap- "Outer region", region of appli- 

pllcability of solution (10-22) cability of solution (10-23) 

Overlap Overlap 
domain domain 



Figure lO'-l. — Re^ons for transition-point expansion. 



fig. 10-1). We therefore require that within the overlap domains the two 
adjacent expansions agree with each other to within an error which is of 
smaller order than the last term retained in these expansions. 

Since the size of the region in which the solution (10-33) applies (which 
we will call the inner region) approaches zero as \— the location of the 
two overlap regions must also approach ito as A.-^ oo. Now in the outer regions, 
the asymptotic expansions correspond to holding the variable x fixed and 
taking the limit A.-^oo. In the inner region, the asymptotic expansions corre- 
spond to holding the variable ^= (x — xo))^^^^ fixed and taking the limit A. c». 
This limiting process allows the coordinate x in the inner region to move toward 
Xo as the size of this region shrinks to zero. Thus, the matching can be per- 
formed in a precise manner by introducing into both the inner and outer ex- 
pansions an "intermediate variable^'' 

n=-{x- xo)k<' = ^\[«-(2/3)] (10-35) 

with a chosen so that a fixed value oiF 7) will remain in the overlap region as 
this region shrinks toward xo with increasing \. The matching of the adjacent 
expansions is then accomplished by changing their independent variables 
from X and ^ to 17 and then requiring that these expansions become identical 
(to the appropriate order in \"^) when the limit \-^oo is taken while holding 
7) fixed. However, if rj is to lie in the overlap regions, we must require that 

0<a<| (10-36) 
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Now in order to apply the matching procedure to this problem, we intro- 
duce the new variable (10-35) into equation (10-33) to obtain 

First, suppose that tj > 0. Then equation (8-37) shows that in the limit \ oo 
with 7] fixed 

+ [-^^y^D^ cos || V^T,3/2\[(2/3)-a]3/2 _ ^| ^^^^ 

(10-38) 

But for T7<0 we find that i73/2=:gi(37r/2)|^|3/2. therefore the argument of 
the BessePs function in equation (10-37) is no longer in the range where equa- 
tion (8-37) holds. We must, therefore, use equation (9-71). 

In this case, we see that in the limit as A.—*' oo with rj fixed 

1 / X" \ f 2 J 1 

1/\a\l/4 r2 1 

+ - ^TTj^j] j ( Die-i""^ + D2 e^l^ ) exp I - ^ Vg^ | tj | x[2/3-a]3/2 j 

to one term (10-39) 
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Next substituting equation (10-35) into equation (10-23) and neglecting 
the higher order terms in X^S we find that 

+ ( -q^j C2 cos |- ^3/2X[(2/3)-a)3/2j (10^40) 

Hence, the expansion (10-38) and the expansion (10-40) will become identical 
in the right overlap domain if 

Ci = Di sin ^+ Z)2 sin 

€2 = Di cos ^ + ^2 cos 

and the expansion (10-23) becomes 

y-Diq-'l^ cos (\ J"" V^o dx-^^ + D2q^'l^ cos ( X J"" ^^^"Y^j 

to one term, for xo<x< b (10-41) 

In order to match the solutions in the left overlap domain, we must consider 
two cases. First, suppose that Di 9^ D2. Then the second term in equation 
(10-39) is negligibly small compared with the first and may be neglected. 
Hence, equation (10-39) becomes 

J / \ 1/4 r 2 

y^2\qoT\v\ J ^^'^^'^ expj^ V9^|7,|3/2X[(2/3)--a]3/2| 

(10-42) 

This must now match with equation (10-22) in the left overlap domain. It 
can be seen that this matching can occur only if C3 # 0. In this case, the 
second term will be exponentially small, compared with the first; and equation 
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(10-22) becomes, upon substituting in equation (10*35) and neglecting 
higher order terms in 1/X while holding t) fixed, 

y-C, (-^)'" {I |7,|3/2XK2/3)-al3/2 | 

But this will match with equation (10-42) in the left overlap domain only if 
^3= (Z)2 — £>i)/2. And the solution (10-22) therefore becomes 




to one term, 



fora<x<xo and Di # D2 (10-43) 

Next consider the case where Di = D2. Then the first term in equation 
(10-39) is zero and, therefore, the second term cannot be neglected. Equation 
(10-22) will only match onto equation (10-39) in the left overlap domain 
if and C4= ( V3/2)I>i. Therefore, equation (10-22) becomes 

y ~ ^^Di {— go)"*/'* exp ^ J ^—qodx^ to one term, 

for a<x<xo and Di = D2 (10-44) 

Thus, the complete asymptotic expansion of the general solution to 
equation (10-11) in the interval a<x<b given by equations (10-33), 
(10-41), and (10-43) or (10-44). The expansions (10-41) and (10-43) or 
(10-44) become poorer and poorer representations of the true solution as 
x^xo (they are nonuniformly valid expansions), but the expansion (10-33) 
provides a good representation in this region. It is possible to obtain a uniformly 
valid asymptotic expansion in the region xo^x<b by adding the expansion 
(10-41) to the expansion (10-33) and (so that it will not be ^ -runted twice) 
subtracting their common value in the transition region given oy equation 
(10-38). Thus,*«^ 

yuniformiyvaiid'-eq. (10-41)+ eq. (10-33)- cq. (10-38) 



*w By construction, cqs. (10-33) and (10-38) arc asymptotically equal in the outer region. 
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Similar remarks, of course, apply for the interval a< xo* Although this 
method is very general and can be used even when a larger number of terms are 
retained in the asymptotic expansion, there is a better method of obtaining a 
uniformly valid one-term asymptotic expansion for the present problem which, 
in fact, applies to the entire interval a< x< b. To this end, notice that the 

term X j Vqodx becomes asymptotically equal to the term 



in the transition region. It is, therefore, reasonable to hope that the range of 
validity of equation (10-33) (whi ch applies for small values of ^^^x—Xo) can be 
extended by replacing 2/3 V^oa ^^'^ in the arguments of the Bessel functions by 

^jxo ^^^^ replacing the factor k^'^ bygo"^'^^^ j Vgo rf:^:^ ^ Upon 

making these substitutions, equation (10—33) becomes 

y-Qo"'[^^ j^^V^odxJ" ^DJif^ (k j^^V^odx^ + D2j-ii3 (k ^odxj]^ 

(10-45) 



Having obtained this result by a heuristic argument, it is now easy to verify 
that, for k^l^{x—xo) = 0{l)^ this equation agrees with equation (10-33) to the 
lowest order k"^ and, for —^0 = 0(1) with x > xo, it agrees to lowest order in 
k~^ with equation (10-41). Similarly, when x-'Xo=0{l) and x<Xo^ it agrees 
to lowest order in k~^ with either equation (10-43) or equation (10-45), de- 
pending on whether Di is equal to D2. Thus, equation (10-45) must represent 
a uniformly valid asymptotic expansion to one term of the general solution to 
equation (10-11). Thio result was first obtained by Langer (refs. 33 to 35) by a 
more forma? procedure. The technique of using inner and outer expansions to 
obtain a uniformly valid expansion began with Friedrichs (ref. 36) in the 1950's 
and was developed by Kaplan, Lagers trom. Cole, and many others. This 
technique not only applies to linear and nonlinear ordinary differential equa- 
tions but also to partial differential equations. Many of the applications of this 
method have been to fluid mechanics problems. In fact, the basic ideas grew 
out of boundary layer theory. 

'03 Xhi? is because f is of order 1 and, therefore, for large X, x must be close to xo* 
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10.3 MATCHED ASYMPTOTIC EXPANSIONS 

The method of using inner and outer expansions to obtain a uniformly 
valid expansion can, in fact, be applied to obtain solutions in a systematic 
way to certain equations which are of the form (10-^). The solution (10-9) 
to equation (10-6) was obtained by essentially guessing its general form. 
Therefore, this procedure is limited to equations of the type (10-6); the method 
of matched asymptotic expansions has no such limitation. 

The method is usually applied in such a way that it is necessary to consider 
the boundary conditions along with the differential equation. The ideas in- 
volved are best illustrated by means of an example. Hov/ever, instead of con- 
sidering an equation containing a large parameter we will now consider an 
equation containing a small parameter e. Thus, we shall seek an asymptotic 
expansion as € 0 of the solution to the equation 

^0+pwf+<?Wy=o (10-46) 

subject to the boundary conditions 

y(0) = l (10-47) 

y(l) = a (10-48) 

and where the functions p{x) and q{x) are any functions which can be repre- 
sented by power series, say 



p(x)=^pnx'' g{x)= '2^ qnx'' (10-49) 

n=0 n=0 

near x = 0^ and by similar power series, say 



n=o 



'^*0f course, since we can always put \=l/€ to obtain an equation containing a large parameter, there is no 
real difference involved. 
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near x=l. We shall also require that 

p{x)>0 (ovO^x^l (10^50) 



and that the integral [ [q{x)lp{x)]dx exists. 

JO 



Since € is small, it is natural to seek a solution to equation (10-46) in the 
form of a power series in €. Thus, let us try to obtain a formal solution to equa- 
tion (10-46) of the form 

y(^;€)=|; yn{x)e^ (10^51) 

n-O 

Upon substituting this into equations (10-46) to (10-48) and equating to zero 
the coefficients of like powers of €, we find that 

P(x)^+q(x)yo=0 (10^52) 

P^""^ ^■^^^''^^""■"'^^^ for 71= 1,2 (10-53) 

yo(0)-l (10-54) 
yo(l) = a (10-55) 

yn(0) = y«(l)=0 forn=l,2, ... " (10-56) 

Since equations (10-52) and (10-53) are first-order linear equations, they 
can be solved immediately to obtain 

yo(^) = Coe-n(^) (10-57) 

ynix) = e-"<-) [ C„+ r e^^-> ^^'^ 1 n= 1, 2, . . . 

^ (10-58) 
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where the Cn for n = 0, 1, 2, . . . are arbitrary constants and we have put 

a(x) - f^'—^dx (10-59) 

Notice that since the integral ft(0) exists by hypothesis, the integral (10-59) 
must certainly be finite for all x in the interval 0 =^ x =^ 1. 

Now, except in the very exceptional circumstance where a = e^^^\ it is 
impossible to choose Co so that the zeroth-order solution (10-57) satisfies both 
boundary conditions. Thus, suppose that a 7^ e^^^^ and, therefore, that one of 
the boundary conditions (10-54) or (10-55) cannot be satisfied. We reason that, 
just as the expansion (10-12) broke down at the transition point, the expan- 
sion (10-51) will break down at one of the boundary points x=0 or x=l 
and it will be necessary to obtain a different (inner) expansion in this region. 
This expansion must then be matched smoothly onto the outer expansion 
(10-51) in some intermediate region. It is necessary to investigate the be- 
havior of the asymptotic solutions at both boundaries in order to find which 
one will correspond to the boundary layer region. If this is done, it will be 
found that, due to the condition (10-50), it will be impossible to match any 
inner solution which occurs near the boundary x=l to the solutions (10-57) 
and (10-58). This is due to the fact that condition (10-50) will cause aU possible 
solutions for the region near a: = 1 to grow exponentially with the distance l—x 
and this type of behavior is incompatible with the solutions (10-57) and (10-58). 

The constants C« for n = 0, 1, 2, . . . must, therefore, be determined 
so that the boundary condition (10-55) and the second boundary condition 
(10-56) at jc= 1 are satisfied. Hence, Co=a and Cn = 0 for /i= 1, 2, . . .; and 
the solutions (10-57) and (10-58) become, respectively, 

yo(:c) = ae~"(^) (10-60) 

yn(^)=-e-"(^) for7i=l,2, . . . (10-61) 

ji p{x) dx^ 

The functions yn(x) forn= 1, 2, . . . can now be determined successively by 
substituting the expression for y^-i obtained in the previous step into the right 
side of equation (10-61). Thus, substituting equation (10-60) into equation 
(10-61) with n= 1 gives 

""Which is frequently referred to as the boundary layer region. 

297 



DIFFERENTIAL EQUATIONS 



y,(jc)=-ae-«W j^'^ [,^{x) - r' ix)]dx (10-62) 
where we have put 

rM (10-63) 
and we shall suppose that the integral 

^^r^ [^U)-^'(^)]^^ (10^64) 

exists. 

Unlike the situation which occurred at the transition point, the zeroth- 
order solution remains bounded at x—0. In fact, its Hrailing value is ac^^^^K 
But in order that the boundary condition (10-47) be satisfied, it is necessary 
that the asymptotic solution change from the ^^1lue 1 to the value ae"^^°^ across 
the boundary layer re^on. Now we antic '^ate that the expansion (10-51) will 
hold over most of the region 0 ^ ac < 1 but that it will break down in a narrow 
region near:r = 0 whose thickness approaches zero as €-->0. Since the asymp- 
totic solution y must change from ae"^^^^ to 1 across this very narrow region, 
the derivatives y' and y must become very steep (large) in this region. How- 
ever, in assuming that the solution had an asymptotic expansion of the form 
(10-51), we were essentially treating the terms y, py\ and qy in equation 
(10-46) as if they were of order 1. In order to overcome this difficulty, we pro- 
ceed just as in the case of the turning point and rescale equation (10-46) in a 
manner which is appropriate to this boundary region by introducing a new 
''stretched" independent variable x by 

where lim 0(e) =0 and the function 0 is to be chosen so that it is of the scale 

of the boundary layer region. In this case, however, it is necessary to determine 
the scaling function <^ in a different manner than in the case of the turning point. 
Thus, upon substituting equation (10-65) into equations (10~46) and (10-49), 
we obtain 
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^^2+ ^(,) ^ + 9(0(e)^)y -0 (10-66) 

where we have put y(:S; €) = y and, in view of equations (10-49) and (10-50), 
pi<f>ie)x)— Po + Pi(f>{e)x + P2(f>^{e)x^ + . . 
q{<l>ie)x)=- qo+ qx<l>{e)x + q2<l>H^W + . . 



for poT^O 

(10-67) 



Now in order that the inner solution satisfy the boundary condition at 
x = 0 and still contain another constant which can be adjusted to match the 
outer solution, we n\ust require that the equation which is satisfied by the 
lowest order term in the expansion of the solution in the inner region (the inner 
expansion) be of second order. This equation is obtained by holding x and y 
fixed and taking the limit^^^ e-» 0 in equation (10-66). However, the limiting 
form of this equation depends on the choice of the function 0(e). And in order 
that the highest order derivative be retained in this equation we must require 
that 

<^=0(e) (10H58) 

If the condition 0=o(e) also held, the second and third terms of the 
limiting equation (10-66) would drop out and we would be left with the equation 



However, if we require that 

<f>9^0{€) (10-70) 

then both the first and second terms wiU be retained in the limiting form of 
equation (10-66). In addition, the size of the inner region (which is determined 
by 0) will be larger if condition (10-70) holds than if it did not hold. Thus, the 



^'^ This limiting process is called the inner limit. The limit taken while holding x and y fixed and letting 0 is 
called the outer limit. 
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solution which would be obtained by assuming that condition (10-70) did not 
hold is a limiting case (for small x) of the inner solution which is obtained when 
equation (10-70) does hold. We shall, therefore, assume that conditions (10-68) 
and (10-70) hold. And since only the order of magnitude of <^ is important, we 
will lose no generality by putting <^(€) = €• Hence, equation (10-66) becomes, 
upon inserting equation (10-67), 

0 + (po + €pxx + €^p2x^ + . . • ) ^+ i^Qo + €^qix + . , . )y = 0 (10-71) 

We now suppose that the solution to equation (10-71) has an asymptotic 
expansion of the form 

fix; €) § y„(x)€« (10-72) 

n=0 

Then upon substituting this into equation (10-71) and equating to zero the 
coefficieols of like powers of €, we obtain 

-#+P»-i=0 (10-73) 

^^+Po^=^n(ic) for/i=l,2, . . . (10-74) 
where we have put 

^«(*)=-S(^*Pn-fc+yfc9n-fc-l) for 71=1,2, . . . 

(10-75) 

And upon substituting equation (10-72) into the boundary condition (10-47), 
we find that 

yo(0) = l (10-76) 



It should not be concluded from the results obtained so far that the asymptotic exponsions of the solutions to 
equations containing a small parameter will always be power series in the parameter. For example, logarithmic terms 
could occur. 
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y„(0) = 0 forn=l,2, . . . (10-77) 

Since equations (10-73) and (10-74) do not contain the dependent variable 
explicitly, they can easily be integrated by the methods of chapter 4 to obtain 

yo = Co+6oe"''^ 

yn — Cn+bne^'*+— | [l — e'^^^^]H nif) dy forn=l,2, . . . 
Po Jo 

which become, after applying the boundary conditions (10-76) and (10-77), 

yo=co+ {l-co)€-r^ (10-78) 

y„=c„(l-e-'^)+- f [l-e"^'"']Hn(y)dy forn=l,2, . . . 
Po Jo 

(10-79) 

We can again determine the functions yn for n== 1, 2, . successively by 
substituting the expressions for yn-i obtained in the previous step into the right 
side of equation (10-79). Thus, upon substituting equation (10-78) into the 
right side of equation (10-79) with n=l and carrying out the integration, we 
obtain 

yi = ci (1 — e P^) + ~ — xe [qo - pi 2" ^J^^^po^ 

(10-80) 

where we have put 

ci == ci + ^ [(1 — Co) (pi — qo) + Cogo] 
Po 
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As in the case of the transition point, we now suppose that there is an 
overlap domain in which the outer expansion (10-51) and the inner expansion 
(10-72) both apply and that within this overlap domain, these two expansions 
agree to within an error which is of smaller order than the last term retained. 
In order to perform this matching, we introduce an intermediate variable 

X €X 

^^=— rT = "TT (10-81) 

into both the inner and outer expansions. The scale factor v{e) is determined 
so that the variable x'^ is of order 1 in the overlap domain. Since the size of 
the overlap domain must approach zero as € 0 and since it must be farther 
away from x = 0 than the inner regions whose size is 0(e) , we must require that 

e = o{p) (10-82) 

and 



v=o{l) 



(10-83) 



To proceed with the matching, we then reexpand the first m terms for //i = 1, 2, 
... of both the inner and outer expansions while holding x'^ fixed and then 
require that the difference between these two expansions be of o(€^""0. That 
is, the inner and outer expansions are asymptotically equal in the overlap 
domain to the appropriate order. Hence, we require that 



yo[v(€)x-^] + €yi[p(e)x-^] + . . . + eyn[v(e)x-^] — jo 



as € -» 0, 



for 71 = 0, 1, 2, . . . with jc+ fixed (10-84) 
Thus, for example, when n = 0, this becomes 



yo[p{€)x-^] — yo 



JC+ j = 0 ( 1 ) as € 0 with x^ fixed (10-85) 
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And when n= 1, it becomes 

yo [v{€)x^ ] + ey, [v{€)x^ ] ^ |^ j - ^cy^ |^ ] - o (e) 

as € ^ 0 with fixed (10-86) 

Now since 

Ji p{vx+) Ji pii) Ji p{$) 

it follows, upon expanding the exponential, that 

And, the solutions (10-60) and (10-62) therefore become, respectively, 

'4-' 

yo[p{e)x^] = ae-"(«> |^1 - ^^(c) ^ +0 (v^)^ (10-87) 

yi M€)x^ ] = ae-"W [4 +0 (v) ] (10-88) 

where definition (10-64) has been used. On the other hand, the solution (10-78) 
becomes 

yo[^:c+] = co+ (l-co)e-Po[Kc)/c]x+ 
But, since equation (10-^2) shows that 
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Um 1^ = 00 

€-»0 £ 



this becomes 

yo :c + j = Co + exponentially small terms ( 10-89 ) 

Similarly, the solution (10-80) becomes 

Yif^-^^^l = Ci — Co ^^-^^^^ + exponentially small terms 
L € J po € 

(10-90) 

Equations (10-87) and (10-89) now show that 

yo[v{e)x^]-yo[^x^^ = ae-n<°) -co+Oiv) 

since the exponentially small terms are of lower order than any power of v. But 
since lim f (e) = 0, this shows that the zeroth-order matching condition (10 -85) 
will be satisfied provided that 

co = ae-n(") (10-91) 

Similarly, equations (10-86) to (10-90) show upon substituting in equation 
(10-91) that 

yo[pie)x*] + en [vie)x^] " [ ^ " cy. [ ^ 
= €[e-n(»W-C,]+0(i/2) 
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Hence, the first-order matching condition (10-86) will now be satisfied if we put 
Ci = ae'^^^^^A and choose the scaling function p so that 

j^2 = o(€) (10-92) 

Notice that v must simultaneously satisfy conditions (10-82), (10-83), and 
(10-92). There are many choices of p which will accomplish this. For example, 
we can take v{e) = e^^^. 

We have now obtained the following results: In the outer region, the expan- 
sion to two terms is 

r{x; €) -oe"«(')fl + € I'' ^[rHx)-r'{x)]dx+ . . .1 (10-93) 

In the inner region, the expansion to two terms is 

+ ae-"<«>^l + e4-g€Jc)+ . . . (10-94) 

And in the overlap domain, both of these expansions take on the common 
value yt given by 

yt - ae-"(o^ (l + eA -p^ex^ (10-95) 

As in the case of the transition point, we can obtain an expansion which 
is valid everywhere in the interval 0 «5 jc ^ 1 (that is, a uniformly valid expan- 
sion) by adding the inner expansion to the outer expansion and, so that it will 
not be counted twice, subtracting their common value in the overlap domain. 
Thus, 

yunlformly valid ^ ae-^^'^ ^ ji " ^' ^^^j 

+ e-p«^|[l-ae-"<«>][l+f (qo-p«-^ '-ae-^(') €a]+ • • • (10-96) 
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Of course, we have not actually proved that equation (10-96) is indeed an 
asymptotic expansion of the solution to equation (10-46) subject to the boundary 
conditions (10-47) and (10-48). However, it is common practice in applied 
mathematics to accept an expansion obtained by a formal procedure (such as 
those given in this section) as being a true asymptotic expansion of the solu- 
tion to the problem. Indeed, most problems which are treated in practice are 
too complicated for rigorous proofs to be carried through. 

We emphasize again that this method applies to nonlinear equations just 
as well as to linear equations. 

10.4 METHOD OF STRAINED COORDINATES 

We shall now consider some additional techniques which can be used to 
handle the nonuniformities that arise when asymptotic solutions are sought 
to certain types of differential equations. Thus, consider the differential 
equation 



^+C02y=€>^ (10-97) 

which describes the oscillation of a mass on a spring with a weakly nonlinear 
restoring force. And for definiteness, let us impose the initial conditions 

y(0) = 1 ^ ^ (1^98) 

If >ve attempt to find an asymptotic solution in the form of a straight- 
foi v/arc power series in e 

y{t\ c) - yo(0 +€yi(0 + . . . 



then we get, upon substituting this into equations (10-97) and (10-98) and 
equating to zero the coefficients of like powers of €, 



-^ + oi2yo = 0 (10-99) 
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^+a)2y, = yg (10-100) 

yo(0) =1 ^ (0) = 0 (10-101) 

at 

y,(0)=^^(0)=0 (10-102) 

However, the solution to equation (10-99) subject to the initial conditions 
(10-101) is yo = cosa}^ And after substituting this into equation (10-100)., we 
obtain 

+ w^Vi = cos^ ct>^ = 7 COS iot-\'\ COS 3a)^ 

But since the general solution to this equation is 

1 3 ^ . 

Vi oo o COS 3co^ + o ~ sin o)t + Ci cos Ojt + C2 sin co^ 



the asymptotic solution to equation (10-97) is 

y cos cof + € I ^ sin — ^,1 » cos Scu^ + Ci cos a>^ + C2 sin con + . . . 

[8 0) 32a>2 J 

However, the first-order term in this expansion will not be small compared 
with the zeroth-order term when t ^ 1/e due to the presence of the term 
t sin (ot in the solution. Such terms are called secular terms. The expansion 
will, therefore, not be valid for large times even though it may be suitable for 
calculating the solution at small times. The solution of equation (10-9?) is 
periodic. However, due to the appearance of secular terms, the solution cannot 
be carried to sufficiently long times to calculate the distortion of the period 
due to the nonlinear restoring force. 

A method (based on the work of Poincare^^®) for alleviating this difficulty 



The i<ieas were developed in the course of his work on periodic orbits of the planets. 
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was developed by Whitham and by Lighthill (ref. 37). The method depends 
upon introducing a new variable r and then considering both the dependent 
variable y and the independent variable t to be functions of r. Thus, 

t= t{r; e) 

And we suppose that these functions can be expanded in powers of € to obtain 



t = T+€fi(T) + . . . (10-103) 
y=yo{T) + €yi{r)+ . . . (10-104) 



The arbitrariness introduced into the solution by the functions ^i, etc., is used 
to adjust the nonhomogeneous terms in the equations for yi, . . • so that 
the secular terms will not occur in the expansion. The resulting distortion of 
the time scale will cause the frequency of the motion to depend on e. And this 
will allow us to calculate the variation of the period. 
Now it follows from equation (10-103) that 

T=TT=Tru-rT ZT=(^-< + - ■ •) T (10-105) 

dt dt dr + ct[ + . . .) dr * dr ^ ' 

where the prime denotes differentiation with respect to t. Hence, . 

g=a-«;-...,|[a-«;-...)(f+.f +...)] 

= a-2«;+...)g=+e$-<f.... 

After substituting this into equation (10-97) together with the expansion 
(10-104) and equating to zero the coefficients of like powers of €, we obtain 

^+a)2yo-0 (10-106) 
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(10-107) 



In order to find the proper boundary conditions, we need expressions for 
the values of y and dyfdt at « = 0 in terms of their values at t = 0. Thus, we use 
a Taylor series expansion of these quantities about t = 0 to obt£un 



^ =(¥) +(#^) r(0) 

at 1^=0 \dt /t^o \aTat/T=o 



where t(0) denotes the value of the function T{t) (obtained by solving equation 
(10-103) forr as a function oft) at the point ^ = 0. Upon substituting in equations 
(10-103) to (10-105), we find 



y(^-0)-yo(0) + 6[yi(0) + ^,(0) (^)J 



dy 
dt 



Then substituting these expressions into the boundary conditions (10-98) and 
equating to zero the coefficients of like powers of 6 shows that 



yo(0) = l ^(0)=0 
dr 

y.(0) + t,(0)^(0) = 0 



(10-108) 
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f'(0)-(;(0)f^(0)+„(0)^(0)=o 

dr dr dr^ 

or, using the boundary condition (10-108) to simplify the second group of 
boundary conditions, 

I 



yi(0) = 0 
^(0) + r.(0)^(0) = 0 



(10-109) 



The solution to equation (10-106) subject to the boundary conditions 
(lQ-108) is 

yo=cosa)r (lO-llO) 

This has the same form as the zeroth-order solution obtained by the regular 
perturbation procedure. However, upon substituting equation (10-110) into 
equation (10-107), the latter equation becomes 

— r-r + cu^yi = cos^ o}T — 2(x}^t[ cos cor— wtl' sin cor 

— ^ cos 3cor+ --2(i}H[^ cos cor — cot'/ sin cor 

We now determine the function ti(r) so that secular terms will not appear in 
the first-order solution yu These terms arise because the solutions cos cor 
and sin cor of the homogeneous equation appear in the nonhomogeneous terms. 
Thus, the secular terms wil! not occur if we choose t\ so that the coefficients of 
these two terms vanish. Hence, we take tj'— 0, t| = 3/8co^, or 



where we have set the constant of integration equal to zero in order to simplify 
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the second boundary condition (10-109). And the differential equation for yi 
becomes 



Now since substituting equation (10-111) into the expansion (10-103) 
shows that 



we find upon neglecting higher order terms in e that 




And when this is substituted into the zeroth-order solution (10-110), we obtain 



Thus, we find that the frequency is modified by the nonlinear restoring 
force even in the lowest order term of this expansion. In contrast to this, the 
direct expansion leads to no information about the frequency change. The 
expansion can be carried to higher orders by continuing to use the functions 
^„for/i = 2, 3, . . . to eliminate the secular terms. And this expansion will be 
uniformly valid for all times since no secular terms will appear. 

10.5 MULTIPLE-TIME METHODS 

Equations which contain two disparate time or length scales are frequently 
encountered in practice. This happens, for example, in problems which involve 
a small force acting over a long period of time. An example of this is a spring- 
mass system subjected to a weak viscous damping. The two times which occur 
in this problem are the basic period of oscillation and the damping time which 
occurs over many periods. The basic idea of the method is due to Kuzmark. 




cos ZoiT 



yo=cos U-^) t 
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And a detailed discussion of this method is given by Kevorkian in reference 38. 
The presentation and examples used herein are taken from this report. The 
method takes into account the long-time effects in such a way as to render 
the expansion uniformly valid. As in the preceding example, it involves reason- 
ing about the first-order terms to determine the zeroth-order solution. 

We set up the expansion in such a way that a fast time variable t and a 
slow time variable t are explicitly exhibited. The slow variable is assumed to 
be related to the fast variable by 



where lim <^(€) = 0. And we suppose that the solution to the differential 
equation has an expansion of the form 



y(t;€)^i/o(€)/o(f*,?) + i/i(€)/i(f*,0 + i'2(€)/2(f*,0 + . . . (10-113) 



where {^ji^) } is an asymptotic sequence as 6 0 and t* is another fast time 
variable related to the fast variable t in such a way that it accounts for the 
change in frequency that occurs in the problem. This relation is taken in the 
form 



where {fiji^)} is another asymptotic sequence and {coj} is a sequence of 
constants which are determined by the problem in such a way as to render 
the expansion (10-113) uniformly valid. 

The variables and Tin equation (10-113) will be treated as independent. 
Hence, the ordinary diSFerential equation satisfied by y wiill be transformed 
into a sequence of partial differential equations. However, it turns out that 
they can still be treated as ordinary differential equations. 

Upon differentiating equation (10-113) with respect to we find that 



(10-112) 



i*==t[l + /£l(€)ft)i + At2(€)0)2+. . .] 



(10-114) 




But since equations (10-112) and (10-114) show that 
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-^ = l + /Lti(€)c0i+^t2(€)a>2+ . . - 



this becomes 



dt 



[1 + Atx(€)a)x+ . . •][M€)|^+^i(€)||i+ . . .] 

+ <^^(€)U(€)^+^X(€)^+. . .1 

I dt dt 1 



or 



f =M6)P[l + Mx(€)a>x]+<^.(€)^}+,.,(€)^+ . . . 

This equation shows that changes which occur on the slow time scale t are 
small compared with the changes which occur on the fast time scale. 

The method is best illustrated by considering a particular example. Thus, 
consider the equation 



which governs the behavior of an osciUalux with weak cubic damping. We 
shall seek an asymptotic solution which is uniformly valid for 0 =^ f ^ oo, subject 
to the boundary conditions 

y (0) = 0 (10-116) 
f (0) = 1 (10-117) 

In this case, it is reasonable to begin by choosing the functions <^ and the two 
asymptotic sequences {pj} and {/tj} to be <^(€) = € and vj=ixj=€K Then 
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f = €f and the expansion (10-113) becomes 
with 

t* = t{l + (02e^+ . . .) 

where we have omitted the term ecoit since we wish to ensure that et only 
occurs in the solution as t Hence, 



dy dfo . fdfo dfi 



dt dt* \dt 3iV 



d'y 32/0 d% d^fi 

— =-^+2e— ^-+e — + 0(e2) 

dt^ dt*2 dt*dt dt*2 



Upon substituting these results into equation (10-115) and equating to zero 
the coefficients of like powers of e, we find that 



|^+/o=0 (10-118) 



P + ^^+(f?)V. = 0 (10-119) 



And since y(0) =/o(0, 0) + e/i (0,0)+. . . and 



There is a certain amount of arbitrariness in the choice of the variables t* and 
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dy 
dt 



(0)=f 



0,0 \Ot 0,0 °^ 0,0 / 



the boundary conditions (10-116) and (10-117) show that 

= 1 



/o(0,0) = 0 ^ 



0,0 



(10-120) 



/i(o,o)=o 



0,0 



dt 



= 0 



0,0 



(10-121) 



Now the solution to equation (10-118) is 

/o(t*,0 = Co(Osint* + Do(Oco8«* (10-122) 

where the functions Co{t) and Do{t) are arbitrary functions arising from the 
integration. But substituting equation (10-122) into the boundary conditions 
(10-120) shows that 

Z)o(0) = 0 Co(0) = l (10-123) 

As in the preceding method, we now determine the functions Co and Do 
so that the first-order solution fi will not contain any secular terms. To this end, 
notice that equation (10-122) implies that 

^|^y= (Co cos t*-Do sin t*Y = Cl cos^ t*-WoCl sin t* cos^ f* 

+ 3i?§Co sin2 t* cos t*-Dl sin^ t* 

Hence, we find, upon using the identities 
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1 3 
COS^ ^* = 7 COS 3t * + T COS t* 

4 4 



1 3 
sin^ ^* = ~ 4 sin 3t* + ^ sin ^* 



sin ^* cos^ ^*== sin — bin^ ^* 



sin^ ^* cos cos — cos^ ^* 



that 



(|{l)' = |Co(C§+X>§) cos^*-|z)o(q + i)§) sin^* 

+ |i>o(D§-3q) sin3^*+|Co(C2~3i)2) cos 3^* (10-124) 

Wc therefore find, after subsliiuliiig equations (10-122) and (10-124) 
into equation (10-119), that 



|^+/. = [|fl.(0§ + C§)+2f2]sin..-[fc.(0§+CS)+2f=] 



C08^^ 



-^Z>o(i)§-3q) sin3^*~iCo(C2-3Z)2) cos 3^* (10-125) 

In order to ensure that secular terms do not occur in /i, we must eliminate 
sin ^* and cos ^* from the nonhomogeneous term of this equation. This can be 
accomplished by putting 



2^»+|z>„(Z)§+6'g)=0 
dt ^ 



2^+lc,{Dl+Cl) = 0 
dt ^ 



(10-126) 
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Upon multiplying the first of these by Do and the second by Co and adding the 
results, we get 

4(^§+C§)+^(D§+C§)2 = 0 
dt 4 

which has the solution 

j)2 4- r 2 = 1 

where Ki is a constant. And substituting this into the boundary condition 
(10-123) shows that we must take Kt = l to obtain 

(10-127) 

But substituting this into the first equation (10-126) shows that 

^dPo 3 Do 
4 

Since the solution to this equation subject to the first boundary condition 
(10-123) is /?o(?) = 0, equation (10-127) becomes 




where the positive square root is taken to ensure that Co satisfy the second 
boundary condition (10-123). Substituting these results into the zeroth-order 
solution (10-122) now shows that 
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Hence, we obtain the one-term uniformly valid asymptotic expansion of 
the solution to equation (10-115) 

sin _ sin t 

The procedure can be continued to obtain higher order terms, the solution to 
any given order being determined by reasoning about the next higher order 
terms. 
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It frequently happens that the differential equations encountered in prac- 
tice cannot be solved by the exact and approximate methods discussed in the 
preceding chapters. In such cases it is often necessary to resort to numerical 
methods in conjunction with a digital computer. Tliese methods usually involve 
replacing the differential equations by a number of algebraic equations, called 
difference equations^ in such a way that the soiiition of the difference equa- 
tions is in some sense close to that of the differential equation. There are a 
large number of numerical procedures available. The choice of method is 
influenced by the type of auxiliary conditions as well as by the form of the equa- 
tion. Thus, when all the auxiliary conditions are imposed at a single point 
(initial conditions), the solution can be developed by means of **marching 
techniques/' which solve the difference equations in succession. These 
marching solutions can be carried out either by using implicit methods such as 
Euler's method and the Runge-Kutta method or by using explicit methods 
such as the Adams method and the improved Euler method. Each of these 
methods has advantages and disadvantages which will be discussed sub- 
sequently. When auxiliary conditions are imposed at two points (boundary 
conditions), it is usually possible to solve linear equations directly by using 
either the superposition principle or finite ditlerence schemes which involve 
matrix methods. However, when the equations are nonlinear, it is often neces- 
sary either to linearize the problem or to reduce it to a set of initial-value 
problems and then use iterative or matrix techniques to obtain the solution. 

The subject of numerical solutions to differential equations is quite vast 
and we cannot hope to cover it completely in a single chapter. For more 
detailed information, the reader is referred to references 39 to 42. 
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11.1 APPROXIMATION BY DIFFERENCE EQUATIONS: ERRORS AND INSTABIUTY 

Consider the general system of nthorder differential equations 

defined on the interval b and subject to appropriate initial or boundary 

conditions. 

In order to obtain a numerical solution to this system we first partition 
the interval a ^ x ^ b. A partition of the interval a ^ x ^ b is defined to be 
any finite set of points xi, xt, . . Xm^i which has the property that a = jci < 
ar2< . . . <Xm+i = 6. The length hj of the yth subinterval,"<> =^ jc ^ is 
called the step size. Thus, 

hi = Xi^i — Xj for j =1,2,. . fn 

The system of differential equations (11-1) is then "replaced" by a set 
of algebraic equations, say 

Cfc(yi, . . ym+i; ^i, . . Xm+i) = 0 for A: = 1, 2, . . p (11-2) 

called difference equations. Their solution is the set of m + 1 vectors yi, . . 
Xm+i, which are approximately equal to the values taken on by the solution 

y = f(:c) of the system (11-1) at the m + 1 points JCi Xm^u Before discussing 

the various methods whereby such difference equations can be constructed, 
we shall first consider certain types of errors which can occur when difference 
equations are used to obtain numerical solutions. 

1 he discretization or truncation error £< at the ith step is defined to be 
the magnitude of the difference between the solution to the differential equa- 
tions at the point x< and the solution y< of the difference equations. Thus 

Ei= If(x,)-y,| 

This error depends only on the type of difference equation used and is inde- 
pendent of the method by which it is solved. 



It is not necessary to have all hj equal, but it is usually desirable. 
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However, there is also an error which is caused by the numerical procedure 
itself* Because a computer can accommodate only a limited number of sig* 
niiicant figures, it cannot store accurately an irrational number or even a 
rational number requiring precision beyond the computer's capability. There- 
fore, the computers themselves introduce an error which results from the 
necessity of rounding off numbers: it is known as the round-off error* The 
round-off error at any step in the computations propagates to the next step and 
is combined ihere with the round-off error of that step. The generation of the 
round-off error at each step is extremely unpredictable. Precisely for this 
reason, analyses of round-off error often treat the error per step as a random 
variable (see ref. 43). 

Closely related to the question of error is the question oi atability^ which 
must be considered in certain instances before a numerical solution can h*i 
obtained. Various types of instability can arise. If the instability is inherent 
in the differential equation itself, it is called an inherent instability* For ex- 
ample, consider the initial-value problem 



dx 



(11-3) 



subject to the initial conditions yi(0) = 1 andy2(0) = — 10, The general solution 
for equations (ll~3) 



And the initial conditions a^e satisfied by taking C| = 1 and C% = 0. However, 
when a numerical procedure is used, it' will usually be impossible to satisfy 
these initial conditions exactly. But a small error in determining the constant 
C2 will then allow the second terms in the solutions to eventually grow so large 
that ihey will dominate /^he first terms, which correspond to the solution being 
sought. Situations of this type arise most frequently when the initial-value 
problem is being solved as part of an iteration procedure to solve a boundary- 
value problem. 
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Instabilities can also arise from the difference equations (even when the 
differential equations are stable). They are then called induced instabilities. 
These instabilities can result in spurious solutions to the difference equations 
which do not correspond to solutions of the differential equations. For more 
details the reader is referred to reference 43. 

11.2 INITIAUVALUE PROBLEMS 

In this section we shall consider certain types of **difference schemes'' 
which are suitable for obtaining numerical solutions to initial-value problems. 

11.2.1 Explicit Methods 

11.2.1.1 One-Step processes: Taylor seri(£S method.--li has been indicated 
in chapter 3 that any normal system of ordinary differential equations can 
always be written as a first^order normal system, which in vector notation has 
the form 

^=G(x.y) (11-4) 

We shall now consider some methods, referred to as one-step processes, 
for obtaining numerical solutions to this equation on an interval a ^ x ^ 6 
subject to the initial conditions y=yi at x = a. For any given partition of 
a^x^6, sayxi, . . x^ + i, we can seek to approximate the solution y = f(x) 
of lilt: system (11-4), subject to these initial conditions, by replacing this 
equation by the set of algebraic equations (or difference equations) 

= + yj)^j for ;= 1,2, . . ., m (11^5) 

It can be seen that, starting with the value y;, equadon (11-5) can be used to 
calculate yj successively at the points y=2, 3, . . ., m+1. We hope that 
the vectors yj w^ill provide good approximations to the values {{xj) of the solu- 
tion to equation (11-4) at the points x> 

The discretization error which occurs when using a difference equation 
to integrate a differential equation across a single step, T(xj^ kj)^ is called the 
local truncation error or the truncation error per step. Thus, the truncation 
error per step is the error induced by using equation (11-5) to calculate 
{(x)+hj) approximately from the value f(xj) ==yj or, symbolically. 
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T{xj,hj)=\yj^i-{ixj+hj)\ 
Hence, upon substituting in equation (11-5) with yj-tixj), we get 
Tixj, hi) = I {{xi)-i{xi-\'hi) -\-G{xi, {ixj))hj I 
But Taylor's theorem shows that 



{(xj-^ hi) = t(xi) + ( £ Aj+ 0(h] 



) 



Hence, 



T{xj,hj)^ 



Cixj,f(xj))-(^§)J\hj-^0{h)) 



But since, by hypothesis, f(x) satisfies the differential equation (11-4), the 
first term vanishes and we obtain 



Tixj,hj)=^0(hj) 



(11-6) 



More generally, we can attempt to approximate the solution to equation 
(11-4) by means of a difference equation of the form 



yj-^i^^yj + ^ixj.yj; hj)hj fory=l,2, . . .,m 



(11-7) 



where the function 0 is to be chosen so that in some sense the solutions to 
equation (11-7) provide good approximations to the solutions of equation 
(11-4) for sufficiently small step size hj. In order that this be the ease, we 
certainly must require that 



^{x, y; h) G(jt, y) as A 0 



(11-8) 



If we again let y==f(,r) be a solution to equation (11-4), the truncation 
error per step T{xjn hj) is 



Thr concept of order and the symbol O arc inirf>duced in chapter 9. 
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T{xj , Aj) = I {(xj ) - {(xj + ) + <I>(;cj , {(xj );hj)hj\ 



The same argument as was used in obtaining equation (11~6) uspH to- 
gether with condition (11-8) now implies that 



This shows that the truncation error per step goes to zero faster than the 
mesh size hj. Other things being equal, it is of course desirable to have the 
truncation error per step approach zero at the fastest possible rate as hj^ 0. 
In order to have some measure of this rate we define the order of a given 
difference scheme to be the largest number p such that 



Equation (11-^6) shows that the order of the diflference scheme (11-5) is 1. 
And, more generally, equation (11-9) shows that the order of any difference 
scheme of the type (11"7) which satisfies condition (11-8) is greater than 
zero. The numerical method corresponding to the diff^^rence scheme (11-5) 
is called Euler^s method. Although this method is very simple, it is prone to 
round-off errors and is therefore infrequently used. 

The truncation error per step can be used to obtain a bound on the (cumu- 
Jative) truncation error for difference equations such as equation (11-7), that 
is, difference equations which determine the solution at the point X}^\ only 
in terms of quantities from the preceding step. Instead of considering the 
general system (11-4), we consider, for simplicity, only the single differential 
equation 



nxr. hi) ^ o{hi) 



as Aj— > 0 



(11-9) 



T{xj;hj)=-Oihf^n 



as Aj— > 0 



dy 
dx 



^G{x. y) 



(11-10) 



Suppose G{x^ y) satisfies the Lipschitz condition with respect y 



|G(x, y) - 0\^M\y-t\ 
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and let 



A = max for 7 = 1, 2, . . m 

hj 

Then it is shown in reference 4 (p. 181) that the truncation error Ej is, at most, 

A(e|x,-x,|A/^l) 
M 



that is. 

Now for any difference scheme of order p, there exist constants Dj inde- 
pendent of the mesh size hj such that 



for 7 = 1, 2 . . m 



And if we put 

€ ^ max hj 
D = max Dj 

then A ^ De^ and the truncation error satisfies the inequality 

Ej ^ ^ {€\^r^.W - 1) for 7 = 1, 2, . . ., /Ti 

which shows that the (cumulative) truncation error is of order €P when the 
difference scheme is of order p. 
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In principle, it is easy to derive formulas for numerical integration of 
the system of equations (11~4) which are of an arbitrarily high order. This 
can be accomplished, for example, by the method of Taylor's series. Instead of 
applying this method to the general system of first-order equations (11—4), 
we shall again, for simplicity, consider only the single first-order equation 
(11-10). There is no difficulty in extending the ideas to the general system 
(11-i). 

Let y='f{x) be a solution to equation (ll~10)andlet^(r<:,y) be any r-times 
continuously differentiable function of x and y. Taking the total derivative of 
g with respect to x along the curve which is obtained by plotting y = f{x) gives 

dx dx dydx dx dy 
Applying this formula to the function gi{x, y) gives 

a7+^ ay"" W ayj W+^a^j^^ fe^^ayj ^ 

and, in general, v/e obtain 

^ dx"" dx dx dy \dx dy) ^ ^ •> •> 

Thus, in the special case when g{x, y) = G(^, y), this equation becomes, in 
view of the differential equation (11-10), 



g=Gx + GG, (11-11) 



^= G^x^2GG^y+ G^Gyy+ G:,Gy+ GGl (11-12) 
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Now suppose that G is p — 1 times continuously differentiable and put 

Then, at least in principle, <I> can be calculated for any integer p simply by 
differentiating the given function G. Hence, when y= /(x> is a solution to equa- 
tion (11-10), it follows from equation (11-13) that 

= I (^Tl)!^ (11-15) 

Thus, the truncation error per step, which is incurred when the difference 
equation 

yHt = yj + ^ixj, yj; fii)hj for7=l,2, . . .,m (11-16) 

is solved to obtain an approximation to the exact solution, y=/(jt:), of the 
differential equation (11-10), is 

Tixj,hj) = \f{xj)-fixj + hj)+^{xjJ{xj); hj)hj I 

But inserting equation (11-15) shows that 
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Hence, upon applying Taylor's theorem we find that 

nxj,hj)=oihf^^) 

which shows that the formula (11-16) with ^ determined by equation (11-14) 
is of order p. The method of Taylor's series is efficient for linear systems or 
even for equations where G is a polynomial of low degree in x and y. However, 
as can be seen from equations (11-11) and (11-12), the method usually becomes 
extremely complex. In order to avoid this complication due to the successive 
differentiation and at the same time to preserve the increased accuracy which 
is afforded by using the Taylor's series method, a technique introduced by 
Runge, Kutta, and Heun known as the Runge-Kutta method can be employed. 
In this case, the function ^ in equation (11~7) is taken to be of the form 

^(^i,yi;/^i)= 2 «ska (11-17) 

where 



ki^G(:tj,yj) (11^18) 

and 

k,-G ^:tj+Mj,yj + Aj 2 for 5 = 2, 3, . . ., r (11-19) 

For any given integer r, the parameters a„ pt„ and \s, n are to be determined in 
such a way that the order p of equation (11-7) is as large as possible. 

For simplicity, we shall again restrict our attention to the single first-order 
equation 

%=G{x,y) a^x^b (11-20) 

In this case, equations (11-7) and (11-17) to (11-19) reduce to 

yj+i = yj+^ixj,yj; hj)hj fory= 1, 2, . . m (11-21) 
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^='2asks (11-22) 

8=1 

kx = G{xj,yj) (11-23) 

k8=G (xj+ iMshj, yj+hj ^ Xs-un fors = 2,3, . . r (11-24) 

N n=l / 

And if y=f{x) is a solution to equation (11-20), the expression for T{xj, hj), 
the truncation error per step, reduces to 

Tixj, hi) = \fixj) ~f{xi+hj) + ^{xj,fixj); hj)hj\ (11-25) 
Applying Taylor's theorem to the function Tixj, hj) gives 



But differentiating equation (11-25) m times gives 

[ dh^- \n=o I "^[dhf-'Jnj^o \dx^)x=xj 
Hence, the method will be of order p, provided that 



m 



0 for m= 1,2, 
^ 0 for m = p+l 



(11-26) 



If we substitute equation (11-13) and equations (11-22) to (11-24) into equation 
(11-26) and equate to zero the coefficients of all the independent partial 
derivatives of G, we wiii get a set of nonlinear equations for a^, fig, and K^n. 
For any given value of r, there will be a largest value of p for which these equa- 
tions can be solved. For 1 ^ r ^ 4, this value of p turns out to be equal to r. 

There is a certain arbitrariness in the solutions of these equations for the 
constants a^, fXs, and K,n. Thus, for r=2, one of these constants can be chosen 
arbitrarily; and for r=3 and r=4, two of the constants can be chosen arbitrar- 
ily. The computations are carried out for the general case in reference 41. 
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Here we shall merely illustrate the method by considering the case where 
r=3. Then equations (11-22) to (11-24) reduce to 



<I> = aiki + a^ki + "3^3 



(11-27) 



k2=G{xj+[Ji2hj,yj+hjki,i ki) 
k3 = G{xj+fji3hj,yj+hj\2,i ki + AjA.2,2 A;2) , 



(11-28) 



Expanding ki, ki, and ka. in a Taylor series about hj=0 and retaining terms 
only up to give 



ki = G{xj,y}) 



\ 



h = G (xj,yj)+hj {(JiiGx+ki, iGGy)x=xj 

y=yj 



+h] (y A^Gx^e+Mi. ,GGxy+YK, ^^^yy)^_^ +0{h^j) 

y=yj 



Kll-29) 



k3 = G (xj, yj) + hj (/X3GX+ A.2. iGGy+X^, 2.GGy)x=3, 

y=yj 



+ h] |^-|-/X§Gxx+ M3 (A-2. 1 + A.2. 2)GGxy+ Y (^2. 1 + ^-2, iYGKf^^y 

+ A.2.2 (M2Gx+Xi,iGGtf) Gy L=x,+0(A?) 

jy=y} 
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Now it is clear that 

1 /B"'<^ 



ml 



is the coefficient of (hj)"' in the Taylor series expansion of 4> about hj=0. 
Hence, when equations (11-29) are substituted into equation (11-27), the 
functions 



1 /a^"4> \ 



m 



0 



for m = 0, 1, 2 are simply the coefficients of A?, Aj, and hj^ respectively, in the 
resulting expression. Thus, 

<I> {xj,yj;0)={ar + a2 + as) G (xj.yj) (11-30) 

=="^2 (M2Cx+Xi.iGCy)x=xj+a3 [fL3Cx+ (^2. 1 + ^2. 2) ^y]x=j:j (11-31) 
+ «3|^| M^Cxx+Zta (^2.1 + \r,2) GGxy+ I {>^2a+^2,2yO^Gyy 

+ A2,2 (At2Cx+X).iCC^) cJ (11-32) 
On the other hand, equations (11-26) show that 
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Upon substituting equations (11-11), (11-12), (11-20), and (11-30) to (11-32) 
into these relations, we find that the resulting equations are satisfied identically 
in xj and yj only if the constants a,, and X,,n are chosen so that the coeffi- 
cients of all the independent derivatives of G vanish. This will occur if, and only 
if, the constants satisfy the following algebraic equations: 

1 

ai + a2 + a3 = 1 fizotz + /^aaa == 2 

/X2Ai,ia2 + /X3(X2,i + X2;i)a3= I M,i^2+ (A2.1 + X2;2)2a3= I 

These equations imply that 

Xl,i = /X2 ^2,1 + X2;2 = /i-S 

and there are four independent equations which must be satisfied by the re- 
maining six unknown constants. Hence, two of these constants can be chosen 
arbitrarily. 

The most frequently used Runge-Kutta method is of the fourth order. 
The values of the constants a„ and X,^„ for the general vector equations 
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Tabl« n-1. — Choict of Param«Ure for 
Fourth-Ord«r Rung^^Kutta Method 



Parameters 


Vt jinri Ar<4 




RungeKutta 
method 


Kutta*8 method 


ai 


1/6 


1/8 


a% 


1/a 


3/8 


Q» 


1/3 


3/8 


Oi 


1/6 J 


1/8 


f^t 


1/2 


1/3 




1/2 


2/3 




1 


1 


X,., 


1/2 


1/3 


Xt.i 


0 


-1/3 


X,j 


1/2 


1 


Xs.i 


0 


1 


Xsj 


0 


-1 


X>j 


1 


1 



(11-17) to (11-19) for the fourth-order Runge-Kutta method are listed in table 
11-1 for two choices of the arbitrary constants, and because of its importance 
the complete formulas for the standard Runge-Kutta method are also listed: 

yj>i = yi+ ^ (ki + 2k2 + 2k3 + k4) 
k,-G(x;,yj) 
k2 = G (xj+^hj, yj+^hjki 



k3 = G y Xj+-hj, yj+ 2 ^jk2 
k4 = G(xj+Aj, yj+hjks) 

There appears to be only a slight advantage which can bo gained by changing 
the choice of the arbitrary parameters. 
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Although the Runge-Kutta mrlliod involves fairly simple formulas, it 
has certain disadvantages. Thus, (1) the method is limited to the fourth or 
fifth order; (2) if the function G is complicated, the evaluation^ of the k, for 
s= 1, 2, 3, 4 at each mesh point can be q?Mte time consuming; (3) it will calcu- 
late a solution even at points of discontinuity without giving any indication that 
this has been done; and (4) there is no readily obtainable error analysis. 

The lack of any error analysis for the fourth-order Runge-Kutta method 
can be partially compensated for by using certain rules of thumb. Thus, for 
example (see ref. 41)^ if the quantity 

k2~-k3 

k,-k2 

becomes much larger than a few hundredths at any point jtj, the step size 
hj should be uecreaseu. 

11.2.1.2 Multistep processes: Finite differences. — Up to this point we have 
been discussing one-step difference equations, that is equations which deter- 
mine the value of the dependent variable at the step jcj+i completely in terms of 
its vahie at the preceding step xj. There are other types of difference equations 
which can be used, called n-step equations,^*^ which utilize the values of the 
dependent variable at the first n preceding steps, say jt/, jt/^i, . . ., xj^n^^i^ 
to determine its value at the stepjcj+i. 

Before discussing these difference equations it is first convenient to in- 
troduce the concept of difference operator. Thus, the difference operators 
A, V, and 8 corresponding, respectively, to the forward difference^ the backward 
difference^ and the central difference are defined by 

AyU) ^y{x + h)-y{x) 

'^yix)^y{x)-y{x-h) 

If the function y{x) is defined only on a finite s«t of points, say Xi<X2< . - - 
< A'm+i '*vith.tj+i ~Xj = /i forj= 1, 2, • • ., m, wc shall sometimes write 



The assDciated numerical procedure is referred to as an n-step process. 
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Then the notation for the first two difference operators becomes 

^Yj = I - yj ^yj = >} ^ 1 

These operators arise in approximating the derivative of functions. The 
nature of this approximation can be seen from the relations 

lim-^. — = hm — ] — = hm-^;r7— = -^^:j — 

Applying these operators twice in succession gives the second differences 
AM^) = A[AyU)]-A[yU + /0-yU)]-yU + 2M-2y(jc + /i)+y(jc 

V2y( jt) = y{x) -2y{x-h) + h(x- 2h ) 

S2yU) =y{x + h)-2yix)+yix-h) 

These formulas can be used to provide approximations to the second deriva- 
tive since 

d^y(x) A?y{x) V2v(x) 8Mx) 
— 71""^ v"^ — ro — ^ ""^ — Li — v"^ — 11 — 



There are various manipulations that can be performed with these and other 
difference operators which are sometimes useful for obtaining finite difference 
equations from differential equations. A fairly detailed discussion of this is 
given in Hildebrand (ref. 44). 

Now consider the general nth-order differential equation in normal form 



dx 



l=^'{^'y'f, <^^x^b (11-33) 
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Suppose that the interval a^x^b has a partition Xi^ Xz, . . Xm+i for which 
all the subintervals xj^ x^ xj^i have the same length h. Upon replacing 
each derivative {d^y)l{dx^) for i=l, 2, . . n in equation (11-33) by its 
forward difference approximation h^^ ^^Yj, where yj is the approximation to 
y [a + (/ 1 ) A J = y ( jc;) , we obtain the difference equation 

A"yj = h-G {xj, yj, y Ayj ^ A-»>^) (1 1 -34) 

However, since ^^yj is a linear combination of yj, y^+i, . . >j+jt, this equation 
is essentially of the form 

yj+m=</)0, yj^ yj+i yj+m-i; A) 

which is clearly an n-step difference equation. 

In fact, even first-order normal differential equations can lead to w-step 
difference equations. Thus, consider the differential equation 

and approximate the derivative by the central difference (yj+i ""yj-i)/2A to 
obtain the difference equation 

yj^t^yj^i + 2hG{xj, yj) 

which is clearly a two-step equation. 

Notice that, in order to start the solution of an n-step method, we must 
have a prior knowledge of the values of yi, yi, ys, . . .» yn, that is, the values 
(or approximate values) of the solution at the first n mesh points. A one-step 
method requires only a knowledge of the initial value yi. Hence, when n> I 
it is in many instances necessary to introduce some auxiliary method for deter- 
mining these values. The one-step methods are, therefore, said to be self- 
starting. In a one-step method, the mesh size hj^ xj+i^-Xj can be varied at 
each step. With a multistep method, it must usually remain fixed. 



336 



NUMERICAL METHODS 



11.2.2 Implicit Methods: Predictor-Corrector 

In the methods discussed so far, the value of the dependent variable 
yj+i at the step xj^i is determined explicitly in terms of its values at one or 
more preceding steps. We can, therefore, calculate the values of the dependent 
variable recursively. Hence, such methods are called explicit methods. There 
are other methods, however, in which the formulas for calculating yj^i from 
the values of the dependent variable at the preceding steps are not solved 
explicitly for yj^i but determine this variable only implicitly. Such methods 
are, therefore, called implicit methods. 

In order to see how difference equations of this type arise, let 

a = xi< X2< . . .<a:m+i = 6 

be a partition of the interval x^ b; suppose that each subinterval Xj^x^ 
Xj^t has the same length, say h; and consider the integral J f{x)dx. Recall 

that this integral can be evaluated numerically in an approximate fashion by 
using either the trapezoidal rule 

or by using Simpson's rule 

fb m-i 1 

Ja p\ 6 

Now, consider the first-order differential equation 

'^ = ^''U,y) (11-35) 

Integrating both sides of this equation first between xj and xj+i and then between 
Xj and Xj+2 gives, respectively. 
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»>i = yj+ I yix))dx (11-36) 

Jxj 



and 

X;>2 = yj+ f'''^'cU,yU))(/x (11-37) 

Upon using the trapezoidal rule for evaluating the integral in equation (11-36) 
and Simpson's rule for evaluating the integral in equation (11-37), we get the 
following finite difference equations for approximating the solution to equation 
(11^5): 

yj^i = yj+ [0{xj^i. yj^i)+G{xj, yj)] | (11-38) 

and 



yj+2==Jj+ [<^ixj^2. >}+2) + 4C(xj+i, yj^i) + G{xj, yj)] I (11-39) 

Notice that in the first of these equations, yj+i appears not only explicitly 
but is involved implicitly through G on the right side. In general, it will not be 
possible to solve this equation to obtain an explicit formula for yj+i. Similar 
remarks, of course, apply to the second equation. If, instead of treating the 
single first-order normal equation (11-35), we consider the general normal 
system 



^ = G(x,y) (11-40) 
ax 

the same arguments would lead to the difference equations 

h 

yj+t = yj+ [G(xj+j, yj+i) + GUj, Yj)] - (11-41) 
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and 

»2 = yj+ [G0rj+2,yj+2) + 4G(xj+,, yj+i) + GUj, yj)] - (11-42) 

Notice that, in equation (11-41), yj+i is determined completely in terms of 
its value at the preceding step; whereas, in equation (11-42), yj+2 is deter- 
mined in terms of the values of the dependent variable at the preceding two 
steps. Since these formulas cannot usually be solved explicitly for the de- 
pendent variable, it is usually necessary to resort to an iteration process at 
each step to find this variable. Thus, let 

U (yj+i) ^ yj+ [G {xj^u yjM) + G {xj, yj)]~ 

Then equation (11-41) can be written as 

y,>, = U(y,>,) (11-43) 

Suppose that by some means a fairly good guess at the solution yj+i of equation 
(11-41) can be made, say y<^\. Substituting this into equation (11-43) gives 
a better approximation y<l^\ to the solution, given by yj^^ = U (y^+\). 

Proceeding in this manner, we obtain the sequence of approximations 

5^V\ = U(>^°\), y<l\ = U(y<i),), y(3)=U(j^i)), . . . 

which we hope will converge fairly rapidly to the solution of equation (11-41). 
A good choice of the initial approximation yj^>j can be obtained by using Euler's 
formula, equation (11-5), to obtain 

y(% = yj + G{xj,yj)h (11-44) 

In practice, instead of solving equation (11-41) accurately for yj+i by 
performing many iterations, we can obtain the same accuracy with much less 
work by taking a finer mesh size h and performing only one or two iterations. 
If only one iteration is performed, the method is called the improved Euler 
method. In this case, we first compute the vector Yj+i, called the predictor, 
from the formula 
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^j^i = yj+G(xj.yj)h (11^45) 
called the predictor formula^ and then substitute it into the formula 

yi+i = yj+ [G U>„ Yj+O+G {xj.yj)]^ (11-46) 

called the corrector formula, to determine yj+i. Thus, in eflfect, yj+i is cal- 
culated from yj in two steps instead of one. Of course, we can apply the same 
procedure lo equation (11-42). This leads to Milne's method. 

These two methods are examples of the predictor-corrector methods. 
Other predictor-corrector methods differ from these only with respect to the 
polynomial interpolation formulas from which the predictor and corrector 
formulas are derived, A commonly used predictor formula is the Adam^- 
Bashforth formula (see ref. 45) 

Yj+i = yj + ^ (55Gj. - 59Gj-i + 37Gj_2 - 9Gj^z) 

where we have put Gj^G{xj, yj). This formula is most frequently used in 
conjunction with the A dams-Mo alt on corrector formula (see ref. 45) 

yj-f 1 = + ^ [9G{xj^r, Yj+i) + 19Gj - 5Gj-i + Gj^^] 

These formulas have a higher order of accuracy than the Euler's formulas. How- 
ever, they are not self-starting. Also, unlike the Runge-Kutta method they 
cannot be easily used alone with a variable mesh size. These difficulties are 
frequently alleviated in practice by using the Runge-Kutta method to obtain 
the starting values and also to compute the solution for the first few mesh 
points after the step size has been changed. However, the predictor-corrector 
methods can, in the case of complicated equations, result in a considerable 
savings in computer time over the Runge-Kutta method. In addition, it is 
usually possible with predictor-corrector methods to monitor the error as the 
calculation proceeds. 

Another difficulty with the predictor-corrector methods is that in some 
cases, they are subject to certain types of instabilities which do not occur 
when the Runge-Kutta method is used. This instability manifests itself first by 
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resulting in an error which is larger than expected; and when one attempts to 
reduce this error by decreasing the step size, the error actually increases. A 
more detailed but elementary discussion of this instability is given in reference 
45. 

11.3 BOUNDARY-VALUE PROBLEMS 
11.3.1 Linear Equations 

11.3.1.1 Use of superposition. — The methods discussed previously have 
all been methods for solving initial-value problems. However, in the case of 
linear equations, these methods can be used in conjunction with the super- 
position principle to obtain solutions to boundary-value problems. Thus, in 
order to solve a boundary-value problem for a linear differential equation, we 
need only solve numerically the same number of initial-value problems as 
the order of the differential equation, provided these problems are chosen in 
such a way that their solutions are linearly independent of one another. It is 
easily seen from section 1,6 that this can always be done by choosing the 
initial conditions of these problems so that they have a nonzero Wronskian 
determinant. Then any boundary-value problem can be solved by forming a 
linear combination of these solutions with the constants adjusted numerically 
to satisfy the imposed boundary conditions. This is a particular example of how 
some a priori knowledge of the properties of the solutions of the equations to 
be solved can be utilized to simplify the numerical procedure for obtaining 
these solutions. 

11.3.1.2 Finite differences. — Another method for solving linear boundary- 
value problems is the method of finite differences. In order to illustrate this 
method, let us consider the second-order linear equation 

r{x) a^x^b (11-47) 



y{a)=^A 
y{b)=^B 
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Let a== jco < ^1 < . . . < ^m+i = 6 be a partition of a x b with equal 
mesh size h. 

Upon approximating the derivatives by appropriate central differences, 

we obtain the following difference-equation approximation to equation (11-47) 

■i . 

yj+i-2yj+yj-^ , yj+i-yj-i _ ._ 

2f^ 1 2h ^^^^ ~ for J = 1, 2, . . . , TO 

where we haye put pj = p{xj) , qj = q{xj)^ and r,- = r{xj). This can be written 
as 

(l " I Pj) yj-i + (h% - 2) jj + (1 + I Pj) = for) = 1, 2, . . . , m 

Upon using the boundary conditions (11-48) to replace yo by A and ym+i by 
B, we obtain the following set of m equations in the m unknowns yi, ya, . . • , 

ym' 

{h'qi - 2) y, + (l + I p. ) y2 = h^r^ + (| p. - l) ^ 
(l - I P2) yi + ( h^qi - 2) y2 (1 + I P2) ya = /tVz 



^1 — I Pm-l) ym-2 + (h^qm-l — 2) ym-l + ^1 + f Pfn-i )>"»»-■ ^^^m-l 

(l-|pm)ym-i+ (/i2gi-2)y,„=/t2r;„- (l + |pm)fi 

This equation can be written in matrix form as 

My=c (11-49) 

where y is the vector y= (yi, y2, . . ym) , M is a matrix of the form 
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Pi 


yi 


0 


0 . . 


. . 0 


. 0 


0 


0 








0 . . 


. . 0 


0 


0 


0 


V 


0:3 


/33 




. . u 


0 


0 


0 


0 


0 


0 


0 . . 


. . 0 


Oim-l 


/3m-l 


7m- 


0 


0 


0 


0 . . 


. . 0 


0 




/3m 



and c is a vector. The entries in M and c are all known since p, q, and r are 
known functions. For obvious reasons, the matrix M is said to be tridiagonaL 
Tridiagonal matrices can be numerically inverted easily and quickly; and, 
therefore, equation (11-49) can readily be solved by inverting M to find the 
solution vector y. A particularly convenient technique is known as the line 
inversion method. In setting up finite difference problems it is not always 
possible to obtain tridiagonal or even n-diagonal matrices. However, whenever 
possible, the difference equations should be set up to obtain n-diagonal matrices 
since they can usually be inverted more easily than other types of matrices. 
In addition, when the system is programed for a digital computer, it is not 
necessary to define all locations of the coefficient matrix M; in the case of 
a tridiagonal matrix, for example, only 3m locations need be allocated to M 
while performing the inversion. In any case the matrices which arise in the 
finite difference methods may usually be inverted by either implicit or explicit 
means. For a discussion of the various methods for accomplishing this, the 
reader is referred to references 46 and 47. It sometimes happens, however, 
that it is not possible to invert these matrices; it is then necessary to use an 
iterative process to solve the matrix equation (see ref. 47). 



11.3.2 Nonlinear Equations 

11.3.2.1 Shooting methods. — Boundary-value problems for nonlinear 
. equations can be solved by using ''''shooting methods.^'* To use these methods 
the probiem is first transformed to an initial-value problem by guessing enough 
additional initial conditions at one boundary to allow the integration to proceed 
across the interval to the other boundary. In the initial trial the specified 
boundary conditions at the second boundary are unlikely to be met. But, by 
adjusting the additional initial conditions imposed at the first boundary, it is 
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possible to come closer to satisfying the prescribed boundary conditions by 
carrying through a number of iterations. 

The required adjustments to the additional initial conditions can be 
made in a number of different ways. Perhaps the most common of these is 
linear interpolation. In order to illustrate the ideas involved, consider a two- 
point boundary-value problem for a second-order system on the interval 
a ^ X ^ b in which the boundary conditions y(a) = A and y{b) = B are 
specified. And suppose that the initial slope y'(a) is to be adjusted until the 
second boundary condition is satisfied. When two values of the initial slope 
y[{a) and 72 (^) have been found which lead to the two boundary values yi(6) 
and 72(6), respectively, such that 

. yiib) ^ B ^ y2{b} 

the next trial value of y'(a) is determined by linear interpolation by using the 
prescription 

/ (a)-yj(a) ^ g-yi(6) 

yitid) -yi(a) y2(6) -yi(6) 

If this new value of y (a) leads to a value y{b) which is either smaller or larger 
than 5, it can be used together with either y2{b) or yi(6), respectively, to 
repeat the process. The process can be continued untiil the second boundary 
condition is satisfied to within the desired accuracy. 

One difficulty with shooting methods which sometimes occurs is that the 
differential equation is so unstable that it **blows up** before the initial-value 
problem can be completely integrated. In such caees the process of quasi- 
linearization can be used. 

11.3.2.2 Quasi'linearization. — Nonlinear boundary-value problems can 
also be solved by reducing them to linear problems by a process of quasi- 
linearization. This process consists of replacing the original equation by a 
sequence of linear equations in such a way that the sequence of solutions to 
these equations converges to the solution of the original equation. Thus, 
consider the first-order normal equation 
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If y is close to y, we might anticipate from Taylor's theorem that 

G{x, y)^G{x,y)-[-—{x,y){y--y) 
We, therefore, replace equation (11-50) by the sequence 

^^^=CU,y<")) + |^(x,y<"))b-<-')_yn)J forn = 0, 1,2,. . . 

(11-51) 

of linear equations for ^"+'1 To use these equations we, first, choose a reason- 
able guess for calculate insert it in the right side, and calculate y^^^K 
Proceeding in this manner, we obtain a sequence of solutions /"^ which we 
hope will converge to the solution y of the original problem. Since each equa*, 
tion (11-51) is linear, it can be handled by the methods described previously. 
These ideas are easily generalized to the first-order normal system 

and, therefore, to any normal system f d'iferential equations. The basic 
reference on the quasi-Iinearization proccr^ is Bellman and Kalaba (ref. 48), 
in which are discussed various conditions which can be imposed on the func- 
tions G to ensure that the iterations converge. 

Although all the most commonly used methods are described in this 
chapter, it is impossible in a single chapter to touch upon all the available 
techniques. For a more complete treatment of the subject, the reader is referred 
to the references cited. 
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specific method, 135 
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Associated Legendre equation, 229 
Associated Legendre functions, 231 
Asymptotic expansion, 262* 265 

nonuniformly valid, 287 

ofasolution. 267. 2a'> 
Asymptotic power series, 265 
Asymptotic sequence of functions, 264 
Asymptotic series, defined, 263, 265 
Autonomous systems of differential equatiotis, 59 

Bernoulli's equation, 45 
BesseFs equation. 241, 277, 288 
Bessel function, 278 

of first kind, 242 

of second kind, 244 

modified, of first and third kind, 246 
Beta function, 156 
Bfjundary conditions, 17, 319, 341 
Branch cut, 144 

Branch of analytic function, 145 
Branch point, 141 

Canonical basis of solutions, 168 
Cauchy estimates, 123 



Cauchy product of two series, 126 
Cauchy-Riemann equations, 114 

Characteristic curves of partial differential equation, 68 
Characteristic equation 

of partial differential equation, 68 

of two algebraic equations, 162 
Characteristic exponents, 177 

difference an integer, 195 

difference not an integer, 188 
Circle of convergence, 122 
Complementary function, 32 
Complete analytic function, 139 
Complex integration, 129 
Complex plane. 111, 116 
Complex variables. 111 

Confluence of singularities in Riemann-Pappentz 

equation, 233 
Confluent hypergeometnc functions, 235 
Conformal mapping, 116 

Critical points of first -order autonomous systems, 64 

Degree of differential equation, 8 
Derivatives 

ot functions ot complex variables', 113 

of vectors, defined, 58 
Difference 

forward, backward, central, 334 
Difference equations, 320 

one-step, 322 

n-step, 334, 336 
Differential (equation 

containing a parameter, 281 

definition, 7 

exact, second order, 93 

equivalent to linear equation, 101 

fundamental theorem, 13, 148, 151 

homogeneous, 8 

linear, 8 

normal, 13 

of first degree, 35 

of first order, 35 

pariiai, 65, 69 
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Diflferrntial equation in complex pian?, 14^ 

analytic continuation of solution, 150 

Taylor »rrir» expansion of solution. 149 
DiacrciUation error (see truncation error) 
Divergent series, as solution of difTerentUI equations, 256 
Domain, 2, 114, 121, 123 

Elliptic equation, 79 
Elliptic functions, 79 
Entire function, 121 
Equation of Painlcve, 102 
Equation splitting, 109 

Equation with dependent variable missing, 74 
Equilibrium solution of first-order autonomous syMem, 64 
Equivalent equations under change of variable (second 

order), 105 
Essential singularity, 120 

of/Mz) and<2(2),252 
Euler^s constant, 245 

equation, 83 

equation, homogeneous, 107 
formula, 112 

integral of second kind, 154 
method, 319, 324 
method improved, 339 
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Finite-difference method, 341 

Finite points of the complex plane, 117, 121 

First integral, 12 

Fuchs theorem, 149 
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with three singular points, 203 
Fuchsian invariant for equation of order two, 206 
Function 
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Fundamental solutions, 33 
Fundamental theorem 

of analytic continuation, 132, 141 
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Gamma function, 154 
Gegenbauer polynomial, 227 
O^Tretric series, 125 

Group theory method for reducing order of equation, 91 

Hankel functions of first and second kind, 246 
Hermite polynomial, 249 

Holomorphic functions ot a complex variable, 1 14 



H(»mogeneous equation 

first order, 43 

of order n, 8 

second order, 79 
Homogeneous Euler equation, 107 
Homogeneous function of degree k, 45 
Homogeneous solution, 24 
Hypergeometric equation 210 

derivative of, 223 

integral form, 222 

Rummer's 24 solutions, 220 

logarithmic solution, 225 

of Gauss, 212 

Whittaker's form, 238 
Hypergeometric functions, 215 

generalized, 224 

Implicit function theorem, 5 

Indicial equation, 177, 199 

of Fuchsian equation with two singular {xiints, 203 
of Fuchsian equation w ith three singular p<»ints, 205 

Infinitesimal operator, 87 

Infinitesimal transformations, 87 

Initial ronditions, 13,319 

Inner asd outer expansions of solution near a transition 

point, 297 
Instability 

in predictor-corrector methiids, 340 

induced, 322 

inherent, 321 
Integral 

first, 95 
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of rystem of equations, 51 
Integral curves of first -order autonomous systems, 64 
Integrating factor 

of first-order equation, 41 

of second-order equation, 97 
Interchange of dependent and independent variables, 107 
Invariant of second-order equation, 105 
Irregular singular points, 173, 251 
Isobaric equation, 43, 81, 93 
Isobaric function, 82 
Isolated singular points 

of analytic functions, 119 

of second*order linear equation. 159 

Jacobi differential equation, 225 
Jacobi polynomial, 226 
Jacobian determinant, 52 

Kummcr*s confluent hypergeometric equation, 235 
first formula, 240 
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second formula, 243 
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Laguerre polynomials, 240 
Lame equation, 249 
Laurent series, 128 
Legendre 

equation. 228 

function of fir^t kind. 228 

function of second kind, 228 

polynomial, 228 

transform, 108 
Linear equations 

differential, 24 

first order, 35 
Linear fractional transformation, 117, 209 
Linear Homogeneou« equation, 106 
Linear independence, 25 
Linear second-order equations, 74 
Linearly independent solutions in complex plane, 151 
Liouville's theorem, 121 

Logarithmic function of complex variable, 145 

Magnification group, 88 

Matched asymptotic expansions, 295 

Mat hie u equation, 24^ 

Meromorphic function, 121 

Method of variation of parameters, 84 

Milne's method, 340 

Modulus of complex number, 113 

Monodromy theorem, 141 (footnote) 

Multiple-time methods, 311 

Muhiple-valued function, 139 

n-dimensional vectors, 57 

Neighborhood, 2 

Non uniform-distortion group, 93 

Normal differential equation, 12 

Normal form of second-order equation, 105 

Normal solutions of irregular singular points. 269 

Normal systems of equations, 49 

One-dimensional equation, 43 
One-step processes, 322 
Order 

defined, 263 

of a diflerential equation, 8 
symbols, 263 
Ordinary point, J 59 

Parabolic cylinder functions, 248 
Parameter, expansions of solutions in, 282 
Partition of an interval, 320 
p-discriminant, 23 
Pockhammer-Barnes function, 236 



Point at infinity, 117, 173 
Polar representation of complex number, 112 
Pole of an analytic function, 119 
Polynomial, 121 

Power series in complex variable, 122 
Predictor-corrector methods, 337 
Primitive, 9 

Principal branch of the logarithm, 145 

Principle of permanence of functional relations, 146 

Quasi-linear partial differential equation, 69 
Quasi-linearization of nonlinear equations, 344 

Radius of convergence, 122, 160 

Rank of an equation, 269 

Rational function, 121 

Recurrence relation, 177, 188, 190, 196 

Regular singular point, 172 

Regular solutions, 170 

Removable singularity, 119 

Riccati equation, 46, 80 

Riemann-Papperitz equation, 205 

Riemann P-symbol, 205 

Rodrigues formula for Jacobi polynomials, 226 
Round-off error, 321 
Runge-Kutta method, 328, 332 

Second-order equations, 73 

with dependent variable missing, 74 
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Secular terms of a solution, 307 
Separable equation (first order), 43 
Shooting methods, 343 
Simple pole, 119 
Simply connected domain, 38 
Single-parameter Lie group, 86 
Singular locus, 23 
Singular point, 25 

of a differential equation, 35, 159 
Singular solutions, 19, 21 
Singularity of solutions, 169 
Solution 

curves, 64 

nf differential equation, 8 

of equation, 5 

general, 10 

particular, 8 

singular, 11, 19 
Solution of second-order linear equation 

at ordinary point, 174 

at regular singular point, 174 

by ch;^nge of variables, 104 

near irregular singular point, 251 

near isol^ed singular point, 160 
Stokes phenomenon, 266, 277 
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DIFFERENTIAL EQUATIONS 



Strained coordinates, method of, 306 

Subnormal solutions of irregular singular points, 274 

Superposition principle, 24 

Systems of equations, normal, 49 

Tables of differential equations and solutions, 110 
Taylor series, 123 
Taylor series method, 322 

Transformation to equation with constant coefficients, 106 
Transition point, 287 
Translation group, 92 
Truncation error, 320 
local, 322 



Tschebychev equation, 228 
Tschebychev polynomial, 228 

Ultraspherical equation, 227 
Ultraspherical polynomial, 227 (footnote) 

Vector functions, 58 

Weber equation, 248 
Weber function, 248 

Whittaker's confluent hypergeometric equation, 238 
Wronskian, 103, 152, 170 
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